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FOREWORD 


While  unit  commanders  and  other  unit  trainers  have  always  played  a  significant  role  in 
training,  they  are  likely  to  become  increasingly  involved  in  the  development  of  that  training  as 
resources  are  reallocated  across  the  Army.  This  is  particularly  true  in  the  area  of  collective 
training  exercise  development.  To  facilitate  development  activities,  tools  are  being  developed 
that  lead  unit  trainers  to  develop  structured  training  exercises  and  the  associated  training  support 
packages  (TSPs).  The  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI)  has  been  a  leader  in  the  development  of  such  tools  through  work  accomplished  in  the 
Armored  Forces  Research  Unit  at  Fort  Knox,  Kentucky.  For  the  past  several  years,  the 
Commanders’  Integrated  Training  Tool  (CITT)  for  the  Close  Combat  Tactical  Trainer  (CCTT) 
has  been  undergoing  development  and  refinement  to  provide  commanders  with  a  tool  to  tailor 
structured  training  in  the  CCTT  to  maximize  its  benefit  in  their  unit  training  strategy.  While 
these  efforts  have  been  largely  successful,  it  remains  to  be  seen  how  well  they  will  work  for 
other  training  environments  and  types  of  exercises. 

This  report  describes  a  project  to  examine  management  and  assessment  of  user-produced 
TSPs  that  will  provide  the  basis  for  the  possible  expansion  of  CITT-like  tools  to  other  collective 
training  environments.  It  provides  a  list  of  TSP  components  around  which  exercise  development 
tools  would  be  developed.  It  specifies  a  methodology  for  identifying  exercises  that  would 
comprise  a  core  set  that  would  serve  as  exemplars  and  which  users  could  modify  to  serve  their 
specific  needs.  It  examines  TSP  assessment  and  distribution  issues  as  well  as  maintenance 
requirements.  It  also  examines  how  the  process  of  user-produced  TSP  development,  assessment, 
and  management  fits  within  the  Army  Training  Information  Architecture. 


The  work  described  in  this  report  was  completed  under  ARI  Work  Package  205, 
“Assessment  of  Force  XXI  Training  Tools  and  Techniques.”  It  builds  upon  ARI’s  development 
of  the  CITT  software  application  as  well  as  a  previous  study  of  distributed  training  development. 
Relevant  requirements  documents  include:  (1)  a  Memorandum  for  Record  (MFR)  between  the 
Chief,  ARI  Armored  Forces  Research  Unit  (AFRU)  and  the  Project  Manager  for  the  Combined 
Arms  Tactical  Trainer  entitled  “Structured  Training  for  the  Close  Combat  Tactical  Trainer, 

25  July  1997;  and  (2)  a  MFR  between  the  Chief  AFRU  and  the  Director  of  Training 
Development  and  Analysis  in  the  U.S.  Army  Training  and  Doctrine  Command’s  Office  of  the 
Deputy  Chief  of  Staff  for  Training  (TRADOC  ODCST)  entitled  “Integration  of  Training 
Development  Among  Schools  and  Distributed  Training  Environments,”  30  November  1998. 

This  report  will  be  of  interest  to  designers  and  managers  of  current  and  future  Army 
training.  A  final  briefing  (in  the  form  of  a  compact  disk)  of  the  findings  and  recommendations 
was  provided  to  senior  TRADOC  ODCST  personnel  in  April  2001.  Personnel  in  the  Army 
Training  Support  Center  are  using  portions  of  the  report  to  specify  future  TSP  elements. 


JUK  M.  SIMUTIS 
Technical  Director 
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EXECUTIVE  SUMMARY 


Research  Requirement: 

Army  training  development  resources  are  becoming  increasingly  limited  and  constrained,  a 
situation  which  is  likely  to  continue.  Additionally,  current  Army  Deputy  Chief  of  Staff  for 
Personnel  (DCSPER)  planning  calls  for  more  resources  to  be  allocated  to  table  of  organization 
and  equipment  (TOE)  units  and  away  from  other  organizations,  making  it  unlikely  that 
centralized  agencies  (e.g.,  U.S.  Army  Training  and  Doctrine  Command  proponent  schools)  can 
anticipate  or  produce  all  the  training  needed  for  any  contingency.  This  will  certainly  place  more 
of  the  burden  of  developing  and  modifying  training  on  the  users  themselves,  particularly 
development  of  collective  training  exercises.  At  the  same  time,  however,  the  complexity  of 
training  has  increased  as  a  result  of  technological  changes  including  much  more  sophisticated 
training  aids,  devices,  simulators,  and  simulations  (TADSS);  the  need  to  prepare  for  varying 
contingencies  involving  a  wider  variety  of  missions;  and  the  possibility  of  conducting  larger- 
scale  training  exercises  combining  live,  virtual,  and  constructive  training  environments.  Thus, 
while  more  collective  training  will  be  developed  by  units,  they  will  need  better  and  more 
sophisticated  tools  and  methods  to  do  so. 

Central  to  the  concept  that  users  will  develop  collective  training  exercises  is  the  need  for 
determining  requirements  for  training  support  packages  (TSPs)  to  support  those  exercises.  What 
are  the  components  of  the  TSPs?  Will  the  same  set  of  components  serve  exercises  for  live, 
virtual,  constructive,  or  combined  training  environments?  What  exercises  would  comprise  a  core 
set  of  TSPs  for  a  given  unit  type?  Elow  will  TSPs  be  assessed  and  managed?  What  tools  will  be 
needed  to  support  user  development  of  TSPs?  How  will  user  development  of  collective 
exercises  and  associated  TSPs  fit  into  the  Army  Training  Information  Architecture  (ATI A)  as  it 
is  currently  being  developed? 

Procedure: 

Answering  these  questions  involved  querying  numerous  sources  from  within  the  Army 
training  community.  Data  were  collected  by  interviewing  various  stakeholders  and  reviewing 
existing  documentation.  Based  on  the  data  collected,  the  project  team  developed  products, 
processes,  and  recommendations  to  address  the  following  project  tasks: 

•  Determine  a  process  that  specifies  requirements  for  a  core  set  of  TSPs  in  various  training 
environments  for  various  types  of  missions  and  exercises.  This  task  focuses  on  training 
for  combat  operations  for  combat  arms  organizations  at  brigade  and  below  at  present  and 
for  the  next  five  years. 

•  Identify  the  components  of  TSPs  required  for  collective  training  exercises  in  live,  virtual, 
constructive,  and  combined  training  environments. 

•  Design  methods  for  assessing  and  managing  user-produced  TSPs  over  the  next  five  years. 


Vll 


•  Identify  prototype  tools  for  assessing  and  managing  user-produced  TSPs. 

Findings: 

The  project  developed  a  process  for  identifying  core  set  exercises.  This  process  involves 
identifying  the  unit  for  which  the  core  set  is  being  specified;  determining  viable  training 
methods,  in  terms  of  exercise  types  and  training  environments,  for  the  unit;  specifying  the 
content  of  the  core  set  in  terms  of  the  collective  tasks  upon  which  it  focuses;  and  identifying  the 
specific  exercises  that  comprise  the  core  set. 

The  components  and  elements  of  a  TSP  for  collective  training  exercises  were  identified  to  a 
level  sufficient  to  develop  database  specifications  for  them,  although  we  did  not  develop  such 
specifications.  As  part  of  this  activity,  the  project  team  also  came  to  the  conclusion  that  the  same 
TSP  components  and  elements  can  serve  all  collective  training  exercises  for  live,  virtual,  and 
constructive  environments. 

A  process  for  assessing  user-produced  TSPs  was  identified  involving  five  levels  of 
assessment  that  may  be  used  depending  upon  how  the  TSP  is  distributed.  Management  issues 
including  how  users  will  access  TSPs,  how  TSPs  might  be  distributed,  and  the  approval  and 
maintenance  processes  for  distributed  TSPs  were  considered  and  recommendations  regarding 
them  were  provided.  Finally,  six  types  of  users  for  TSPs  were  identified  including  developers, 
exercise  support  personnel,  observer/controllers,  site  personnel,  unit  administrative  support 
personnel,  and  the  unit  itself.  Requirements  that  each  of  these  user  types  will  have  for  the 
information  contained  in  the  TSP  are  discussed  along  with  the  type  of  user  tool  or  application 
that  would  serve  each  user’s  needs. 

Utilization  of  Findings: 

This  project  has  examined  issues  related  to  user-produced  TSPs  in  depth.  Its  results  can 
benefit  units  who  are  developing  their  own  collective  training  exercises,  as  well  as  proponents 
who  develop  and  maintain  core  set  exercises.  In  addition,  future  efforts  to  develop  the  ATIA  and 
corresponding  training  information  systems  can  build  upon  the  work  completed  here  to  make  full 
use  of  the  unit-based  training  resources  that  exist  throughout  the  Army. 


viii 


ASSESSING  AND  MANAGING  USER-PRODUCED  TRAINING  SUPPORT  PACKAGES 


CONTENTS  _ _ 

Page 

INTRODUCTION .  1 

Structured  Training .  2 

User-Produced  Training .  3 

Army  Training  Information  Architecture .  4 

PROJECT  OBJECTIVES  AND  TASKS .  6 

PURPOSE  AND  ORGANIZATION  OF  THE  REPORT .  7 

DATA  COLLECTION . .  8 

TSP  CORE  SET  IDENTIFICATION .  9 

A  Process  for  Identifying  Core  Set  Exercises .  10 

TSP  COMPONENT  AND  ELEMENT  IDENTIFICATION .  17 

The  TSP  Component  Identification  Process .  1 8 

Validation  of  the  TSP  Component  and  Element  List .  21 

USER-PRODUCED  TSP  MANAGEMENT  AND  ASSESSMENT .  25 

Assessment  of  User-Produced  TSPs .  25 

Access  to  User-Produced  TSPs .  28 

Distribution  of  User-Produced  TSPs .  29 

User-Produced  TSP  Approval .  33 

User-Produced  TSP  Maintenance .  33 

USER  TOOLS . 34 

TSP  Users  and  Application  Requirements .  35 

An  Example  User  Application .  36 

Additional  User  Application  Issues .  37 

SUMMARY  AND  CONCLUSIONS .  39 

REFERENCES .  41 


IX 


CONTENTS  (continued) 


Page 

APPENDIX  A.  ACRONYM  AND  ABBREVIATION  LIST .  A-l 

B.  PROJECT  SOURCES .  B-l 

C.  TSP  COMPONENTS  FROM  TR  350-70 .  C-l 

D.  TSP  COMPONENTS  FROM  TC  25- 10 .  D-l 

E.  COLLECTIVE  EXERCISE  TSP  COMPONENT  AND  ELEMENT  LIST  E-l 

F.  COLLECTIVE  EXERCISE  TSP  ELEMENT  LIST  -  TR  350-70 

CROSSWALK .  F-l 

G.  COLLECTIVE  EXERCISE  TSP  ELEMENT  LIST  -  COLLECTIVE 

WARFIGHTER  TSP  ELEMENTS  CROSSWALK .  G-l 

LIST  OF  TABLES 

Table  1 .  Sample  Rationales  for  Determining  the  Viability  of  Training  Methods .  1 3 

LIST  OF  FIGURES 

Figure  1 .  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 

structured  training  development  process .  2 

2.  Top-level  node  tree  -  Army  Training  Information  Architecture  Operational 

Architecture .  5 

3.  The  core  training  support  package  set  identification  process .  11 

4.  Matrix  of  possible  training  methods  for  armor  and  mechanized  infantry  units.  12 

5.  Viable  training  methods  for  armor  units .  12 

6.  An  example  of  task  filtering  for  a  tank  platoon .  14 

7.  An  example  of  identifying  storylines  for  a  tank  platoon .  15 

8.  An  example  of  identifying  specifications  for  collective  training  for 

a  tank  platoon .  16 

9.  An  example  of  specifying  core  set  training  support  packages  for 

a  tank  platoon .  17 

1 0.  The  training  support  package  component  identification  process .  19 

1 1 .  TSP  components  and  elements .  22 

12.  Training  support  package  assessment  levels .  26 

13.  Training  support  package  distribution  methods .  30 

1 4.  Training  support  package  access  and  retrieval  processes  for 

Centrally  and  Widely  Distributed  methods .  3 1 

15.  The  TSP  packaging  process .  32 

1 6.  Example  functionality  for  the  observer/controller  application .  37 


x 


ASSESSING  AND  MANAGING  USER-PRODUCED  TRAINING  SUPPORT  PACKAGES 


Introduction 

Army  training  development  resources  are  becoming  increasingly  limited  and  constrained,  a 
situation  which  is  likely  to  continue  into  the  near  future.  As  the  Deputy  Chief  of  Staff  for 
Personnel  (DCSPER)1  Lieutenant  General  Maude  (2000)  recently  wrote: 

The  Army  Chief  of  Staff  has  tasked  the  DCSPER  to  staff  the  Army  fully  by  2003, 
with  the  requirement  to  staff  the  10  divisions  and  two  armored  cavalry  regiments 
fully  by  the  end  of  fiscal  year  2000.  This  is  a  significant  challenge  and  will  result  in 
the  short-term  understaffing  of  table  of  distribution  and  allowances  (TDA)  units  until 
the  force  structure  has  been  realigned  to  reflect  inventory  realities,  (p.  145) 

This  is  further  reinforced  by  the  Army  Training  XXI  Campaign  Plan  (U.S.  Army  Training 
and  Doctrine  Command  [TRADOC],  1997)  which  states:  “The  foreseeable  future  will  remain  an 
era  of  constrained  resources.  The  effect  of  resource  constraints  will  be  felt  in  the  availability  of 
dollars,  training  force  structure,  and  training  time.” 

Since  current  Army  DCSPER  planning  calls  for  more  resources  to  be  allocated  to  table  of 
organization  and  equipment  (TOE)  units  and  away  from  other  organizations,  it  is  unlikely  that 
centralized  agencies  (e.g.,  TRADOC  proponent  schools)  can  anticipate  or  produce  all  the 
training  needed  for  any  contingency.  This  will  certainly  place  more  of  the  burden  of  developing 
training  on  the  users  themselves,  particularly  development  of  collective  training  exercises.  At 
the  same  time,  however,  the  complexity  of  training  has  increased  as  a  result  of  technological 
changes  including  much  more  sophisticated  training  aids,  devices,  simulators,  and  simulations 
(TADSS),  the  need  to  prepare  for  varying  contingencies  involving  a  wider  variety  of  missions, 
and  the  possibility  of  conducting  larger-scale  training  exercises  combining  live,  virtual,  and 
constructive  training  environments.  Thus,  while  more  training  will  be  developed  by  units,  they 
will  need  better  and  more  sophisticated  tools  and  methods  to  do  so. 

Two  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  long-term 
initiatives  directly  address  thesfe  issues  in  the  collective  training  arena:  structured  training  and 
user-produced  training.  At  the  same  time,  a  TRADOC  initiative,  development  of  the  Army 
Training  Information  Architecture  (ATIA),  is  determining  the  overall  environment  in  which 
user-produced  training  will  be  developed  and  implemented  for  the  foreseeable  future. 
Implementation  of  findings  from  the  ARI  initiatives  must  address  and  be  compatible  with 
training  systems  that  will  be  developed  within  the  context  of  the  ATIA. 


1  All  acronyms  used  in  this  report  are  included  in  Appendix  A. 
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Structured  Training 

Structured  training  fully  supports  the  Army’s  training  doctrine  as  stated  in  Field  Manual 
(FM)  25-100  (Department  of  the  Army  [DA],  1988)  and  is  consistent  with  the  Army’s  Systems 
Approach  to  Training  (SAT)  process  as  explicated  in  TRADOC  Regulation  (TR)  350-70 
(DA,  1999).  Building  on  early  work  in  structured  training  completed  by  Brown  (1991)  in 
conjunction  with  training  of  the  Reserve  Component,  ARI  has  been  a  leader  in  developing 
structured  training  principles  and  methodology.  Campbell,  Quinkert,  and  Burnside  (2000) 
provide  a  comprehensive  review  of  work  conducted  in  structured  training  over  the  last  decade. 
In  this  report,  they  describe  structured  training  programs  or  exercises  as  having  “five 
characteristics:  an  explicit  task  focus,  a  realistic  scenario,  focused  task  performance  feedback,  a 
training  support  package  (TSP)  to  assist  preparation  and  ensure  standardization,  and  a  linkage  to 
a  larger  training  strategy  or  family  of  programs”  (p.  4).  These  characteristics  have  evolved  and 
been  refined  through  the  course  of  a  number  of  projects  involving  the  development  of  live, 
virtual,  constructive,  and  combined  collective  training  exercises. 

To  facilitate  the  application  of  structured  training,  ARI  produced  a  procedural  model  for  its 
development  as  shown  in  Figure  1  (Campbell  et  al.,  2000).  This  model  is  based  on  the  SAT 
process  specifically  adapted  to  structured  collective  training  exercises.  In  Phase  1,  initial 
decisions  are  made  regarding  assumptions,  constraints,  and  training  expectations,  and  the 
training  audience  and  type  of  simulation  are  specified.  Phases  2  and  3  occur  in  parallel  and 
involve  specifying  the  objectives  of  the  training  and  the  design  of  the  tactical  scenario  for  the 
exercise.  Phase  4  involves  the  preparation  of  the  materials  required  to  support  the  exercise  -  the 
TSP.  Throughout  all  activities,  there  is  an  ongoing  process  of  formative  evaluation,  the  purpose 
of  which  is  to  monitor  and  improve  the  structured  training  products. 


Figure  1.  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  structured 
training  development  process. 

While  all  activities  in  the  process  are  important,  the  TSP  is  key  to  making  the  structured 
training  process  work  and,  for  collective  training,  is  defined  in  TR  350-70  as:  “A  complete, 
stand-alone,  exportable  training  package  integrating  training  products  and  materials  needed  to 
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train  one  or  more  collective  tasks  and  supporting  critical  individual  tasks  (including  leader  and 
battle  staff).  It  is  a  task-based  information  package  that  provides  a  structured  situational  training 
scenario  for  live,  virtual,  or  constructive  unit  or  institutional  training”  (DA,  1999,  p.  V-7-4).  The 
specific  components  of  a  collective  TSP  (referred  to  as  a  Warfighter  TSP  in  TR  350-70)  have 
continued  to  evolve,  and  it  remains  questionable  whether  a  single  set  of  TSP  components  will 
work  for  all  collective  training  exercises,  or  different  TSPs  will  be  required  depending  on  the 
exercise  supported  (Shlechter  &  Finley,  2000). 

The  efficient  use  of  training  resources  in  any  single  or  combined  environment  requires  that 
training  be  structured  to  meet  specific  objectives  or  needs.  One  way  that  this  has  been  done, 
primarily  for  virtual  and  constructive  environments,  has  been  to  design  training  deliberately  to 
include  events  or  cues  that  prompt  the  performance  of  particular  tasks  or  portions  of  tasks.  It  is 
in  implementing  this  degree  of  structure  in  training  exercises  that  the  use  of  TSPs  assumes 
particular  importance.  It  is  also  this  degree  of  structure  that  allows  and  supports  the  possibility 
that  users  can  themselves  develop  training  exercises  along  with  the  TSP  materials  necessary  to 
support  them,  which,  in  turn,  requires  that  any  tools  or  applications  developed  to  assist  the  user 
be  based  upon  and  thoroughly  grounded  in  structured  training  methodology. 

User-Produced  Training 

The  second  initiative  that  impacts  the  anticipated  shortage  of  proponent-produced  training 
exercises  is  the  move  to  user-produced  TSPs,  where  users  are  defined  as  unit  commanders  and 
other  unit  trainers  as  well  as  institutional  trainers  who  will  be  directly  involved  with  executing 
the  exercises  they  produce.  An  ARI-sponsored  series  of  projects  conducted  over  the  past  three 
years  has  demonstrated  the  feasibility  of  user-produced  collective  exercises,  at  least  for  training 
in  a  virtual  environment  (Gossman  et  al.,  1999;  Gossman  et  ah,  2000).  These  projects  have  been 
based  on  the  concept  that,  to  some  extent,  users  of  training  in  any  environment  will  increasingly 
need  to  develop  their  own  TSPs,  or  at  least  modify  a  core  set  of  TSPs.2  The  major  product  of 
these  ARI  projects  is  the  Commanders’  Integrated  Training  Tool  (CITT)  for  the  Close  Combat 
Tactical  Trainer  (CCTT).  The  CCTT  is  a  virtual  training  system  that  supports  the  training  of 
collective  tasks  and  supporting  individual  and  leader  tasks  for  armored  and  mechanized  infantry 
units,  including  combat  support  and  combat  service  support,  at  the  platoon  and  company/team 
levels.  It  includes  the  capability  to  support  battalion  task  force  (and  perhaps  brigade)  training  as 
command  field  exercises  or  as  portions  of  larger  exercises.  Research  conducted  during  these 
projects  determined  that  users  often  have  little  formal  training  and  practical  experience  in 
training  development;  thus,  they  benefit  from  having  guidelines  and  automated  tools  to  help 
them  produce  high  quality  exercises.  Among  the  key  lessons  learned  from  the  CITT  projects 
conducted  to  date  are  that  users  can,  with  the  assistance  of  the  CITT,  develop  quality  structured 
training  exercises  and  their  associated  TSPs.  To  do  this  efficiently  and  effectively  the  “user 
needs  to  have  a  good,  working  understanding  of  the  concepts,  principles,  and  practices  of 
structured  training  development  and  delivery”  (Gossman  et  al.,  2000,  p.  29). 


2  This  project  recognizes  that  unit  commanders  and  other  unit  trainers  have  historically  developed  their  own  training. 
The  emphasis  of  user-produced  TSPs  is  actually  on  providing  appropriate  tools  and  aids  to  support  their  efforts  and 
to  assist  them  in  producing  high-quality,  effective  and  efficient  training  for  all  training  environments. 
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The  CUT,  as  a  prototype  exercise  and  TSP  development  tool,  provides  access  to  extensive 
user-oriented  information  on  the  CCTT  and  how  to  train  units  in  the  CCTT.  This  includes  access 
to  a  library  of  existing  TSPs  and  detailed  guidelines  and  procedures  for  modifying  these  TSPs 
and  for  developing  similar  ones.  The  CITT  also  provides  procedures  for  preparing  electronic 
files  required  for  initialization  and  control  of  exercises  in  the  CCTT.  The  prototype  CITT  has 
been  well  received  in  two  rounds  of  formative  evaluation  with  users,  and  there  are  indications 
that  a  CITT-like  tool  will  be  highly  beneficial  in  addressing  the  training  issues  identified  above. 
Before  CITT  capabilities  are  expanded  to  other  training  environments,  however,  there  are  several 
underlying  research  and  development  issues  related  to  assessment  and  management  of  user- 
produced  TSPs  that  need  to  be  addressed: 

•  What  are  the  training  environments  in  which  user-produced  TSPs  are  required? 

•  What  components  must  be  included  in  TSPs  developed  for  different  or  combined 
environments? 

•  If  TSP  development  is  distributed  among  users,  how  will  it  be  standardized,  controlled,  or 
managed? 

•  How  will  users  collaborate  to  produce  TSPs  for  large-scale  exercises  combining  different 
sites  or  training  environments? 

•  How  will  TSPs  be  judged  as  complete  and  acceptable  for  inclusion  in  a  user-accessible 
library? 

•  How  will  access  to  such  a  library  be  controlled? 

•  What  tools  and  aids  are  currently  available  to  support  distributed  TSP  development,  and 
what  tools  and  aids  are  needed? 

This  report  addresses  this  set  of  issues  through  design  of  methods  for  assessing  and 
managing  user-produced  TSPs  at  brigade  and  below  levels,  along  with  specification  of  initial 
prototype  user  tools.  As  such,  it  represents  a  further  extension  of  the  principles  of  structured 
training  to  an  environment  in  which  users  are  the  primary  developers  of  training. 

Army  Training  Information  Architecture 

The  third  initiative  that  impacts  user-produced  training  is  the  ATIA  under  development  by 
TRADOC.  Based  on  the  Army  Training  XXI  Campaign  Plan  (TRADOC,  1997),  the  ATIA  is  a 
specification  for  a  system  of  systems  that  will  be  developed  over  the  next  several  years  and  will 
provide  the  blueprint  for  future  training  systems  in  the  Army.  It  is  a  standards-based,  data- 
driven,  object-oriented  system  based  on  the  Army’s  SAT  process  and  applies  to  Army  training  as 
described  in  TR  350-70  (DA,  1999).  As  illustrated  in  the  top-level  node  tree  for  the  ATIA 
Operational  Architecture  depicted  in  Figure  2,  the  ATIA  specifies  activities  for  designing, 
developing,  implementing,  assessing,  and  managing  collective  training  including  the  user- 
produced  exercises  and  TSPs  considered  in  this  project.  According  to  the  Army  Training  XXI 
Campaign  Plan, 
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The  ATIA  will  employ  state-of-the  art  information  technologies  in  a  fully  integrated, 
networked,  and  internetted  training  support  system  to  provide  realistic,  timely,  user- 
responsive,  and  cost-effective  training  for  units  and  individuals.  The  objective  Army 
training  system  will  provide  integrated  and  distributed  training  information  and 
training  management  support;  comprehensive,  configurable,  content-rich  training 
products  and  media;  integrated  synthetic  training  tools  and  devices;  and  reengineered 
training  processes  -  all  in  an  open  system  capable  of  continuous  improvement  through 
the  infusion  of  emerging  technologies  and  functional  requirements.  The  ATIA  will 
support  the  entire  training  domain  -  from  tools  to  training  development  to  training 
methods  -  while  maintaining  the  quality  of  our  battle-focused  training  paradigm. 
(TRADOC,  1997) 
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Figure  2.  Top-level  node  tree  -  Army  Training  Information  Architecture  Operational 
Architecture  (DA,  2000a). 

The  ATIA  is  being  developed  by  TRADOC  under  a  set  of  principles  and  guidelines  that 
provide  the  strategic  guidance  for  a  coherent  technical  framework  for  the  future  ATIA  system. 
The  ATIA  and  its  principles  and  guidelines  are  of  particular  relevance  to  this  project  in  that  they 
provide  constraints  on  it,  particularly  as  related  to  user  tools  and  management  and  assessment  of 
TSPs,  in  that  our  findings  and  recommendations  must  address  and  fall  within  the  ATIA.  The 
following  ATIA  principles  are  of  particular  relevance: 
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•  Data  access  should  be  logically  centralized,  but  physically  dispersed. 

•  Software  applications  and  data  should  be  segregated. 

•  Data  content  should  be  modifiable  on  the  fly  and  all  abstractions  of  data  (e.g.,  meta-data) 
should  be  extensible  and  user-,  not  programmer-,  oriented. 

In  addition,  the  following  guidelines  offer  further  direction: 

•  Systems  and  subsystems  will  be  user-focused  and  user-friendly. 

•  Systems  and  subsystems  will  be  interoperable. 

•  The  ATIA  training  management  systems  will  provide  for  one-time  data  entry  to  update 
all  related  systems’  databases. 

•  All  training  information  will  be  available  and  tailorable  through  training  management 
systems. 

Thus,  user-produced  TSPs,  viewed  as  data,  need  to  satisfy  these  guidelines  and 
requirements,  as  must  any  user  tools  (i.e.,  applications). 

The  prospect  of  relying  increasingly  on  structured,  user-produced  training  raises  questions 
about  how  the  resulting  TSPs  should  be  developed  and  managed.  Automation  is  part  of  the 
answer,  but  tools  that  assist  with  these  functions  must  be  designed  within  the  constraints  imposed 
by  the  ATIA.  Together,  these  factors  demand  timely  research  into  how  the  Army  can  integrate 
user-produced  TSPs  effectively  into  existing  training  approaches.  The  ARI  has  responded  by 
initiating  and  guiding  the  present  project. 

Project  Objectives  and  Tasks 

Four  major  objectives  from  the  project  Statement  of  Work  (SOW)  (ARI,  1999)  drove  the 
project  activities: 

•  Design  a  method  for  specifying  the  collective  training  exercises  that  would  comprise  a 
“core  set”  for  training  combat  arms  organizations  at  brigade  and  below  including  the 
development  of  at  least  one  example  core  set.  The  specification  should  consider  unit  type 
and  echelon,  training  mission,  training  environment,  and  TADSS. 

•  Determine  the  data  components  that  comprise  a  TSP  for  collective  exercises. 

•  Design  comprehensive  methods  for  assessing  and  managing  user-produced  TSPs  for 
collective  training. 

•  Identify  selected  tools/aids  for  assessing  and  managing  user-produced  TSPs  for  collective 
training. 
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These  objectives  were  addressed  through  completion  of  several  research  tasks: 

•  Task  1.  Determine  requirements  for  a  core  set  of  user-produced  TSPs  in  various  training 
environments  at  present  and  for  the  next  five  years  including  the  identification  of  specific 
TADSS  as  well  as  identification  of  the  types  of  missions  and  exercises  for  which  user- 
produced  TSPs  are  expected  to  be  required.  This  task  focuses  on  training  for  brigade  and 
below  combat  operations. 

•  Task  2.  Identify  the  components  required  for  TSPs  in  live,  virtual,  constructive,  and 
combined  training  environments  for  collective  training  exercises. 

•  Task  3.  Design  a  method  for  assessing  and  managing  user-produced  TSPs  over  the  next 
five  years. 

•  Task  4.  Identify  prototype  tools/aids  for  assessing  and  managing  user-produced  TSPs. 

As  the  project  proceeded  these  tasks  were  refined  somewhat  based  on  input  from  the 
contracting  officer’s  representative  (COR),  on  the  combined  expertise  and  experience  of  the 
team,  and  on  outcomes  that  we  could  realistically  expect  to  produce.  Task  1  changed  to 
developing  a  process  or  methodology  for  identifying  the  TSPs  (or  exercises)  that  need  to  be 
included  in  a  “core  set”  of  exercises  rather  than  specifying  the  actual  core  sets.  Task  2  was 
further  defined  as  identifying  the  TSP  components  to  a  level  sufficient  to  develop  database 
specifications  for  them.  We  made  no  attempt,  however,  to  develop  the  actual  specifications. 

Task  4  evolved  into  identifying  the  various  users3  of  the  TSP  and  the  applications  or  tools  that 
each  will  need  in  order  to  develop  and  execute  collective  training  exercises  effectively  and 
efficiently.  Prototype  screen  shots  illustrating  the  functionality  of  one  tool  were  also  developed. 

Purpose  and  Organization  of  the  Report 

The  purpose  of  this  report  is  to  describe  the  research  methods  and  outcomes  of  the  project  to 
examine  methods  for  assessing  and  managing  user-produced  TSPs.  As  described  above,  this 
included  examining  TSP  components,  a  method  for  specifying  core  sets  of  TSPs,  issues  related 
to  TSP  assessment  and  management,  and  development  of  prototype  tools  for  the  various  TSP 
users  identified. 

The  report  is  organized  as  follows: 

•  Data  Collection.  This  section  describes  the  data-collection  methods  we  employed  for 
collecting  the  data  that  underlie  the  project  as  a  whole.  (Methodological  activities  related 
to  specific  project  tasks,  e.g.,  development  of  the  TSP  core  set  identification  process,  are 
described  within  the  context  of  presenting  the  task  activities). 


3  As  employed  in  this  context,  “user”  refers  not  only  to  the  developer  of  the  TSP,  but  to  all  personnel  who  will  make 
use  of  the  information  contained  in  the  TSP  to  execute,  or  support  the  execution  of,  the  exercise. 
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•  TSP  core  set  identification.  This  section  describes  the  methodology  that  was  developed 
to  identify  the  specific  exercises  that  could  be  included  in  a  core  set  of  exercises  for 
various  combat  organizations.  We  also  provide  specific  examples  of  the  core  set  of 
exercises  that  would  be  derived  using  the  methodology  developed. 

•  TSP  component  and  element  identification.  This  section  describes  the  process  and 
product  of  the  analysis  to  identify  the  data  elements  that  would  be  included  in  a  TSP  for 
collective  training  exercises  for  various  training  environments. 

•  User-produced  TSP  management  and  assessment.  This  section  identifies  issues  and 
concerns  related  to  management  and  assessment  of  user-produced  TSPs  over  the  next  five 
years  based  upon  our  analysis  of  the  ATIA. 

•  User  tools.  This  section  identifies  a  set  of  tools  for  the  various  TSP  users  and  provides 
suggestions  for  their  development  and  use. 

•  Summary  and  Conclusions.  This  section  presents  a  summary  of  the  project  findings  and 
a  set  of  recommendations  for  addressing  management  and  assessment  of  user-produced 
TSPs  at  present  and  for  the  next  five  years. 

Data  Collection 

Initial  project  activities  consisted  of  identifying  and  obtaining  documentation  relevant  to 
structured  training,  TSPs,  and  Army  training  in  general  that  would  support  all  project  tasks.  We 
began  with  Field  Manual  (FM)  25-100  -  Training  the  Force  (DA,  1988),  FM  25-101  -  Training 
the  Force:  Battle  Focused  Training  (DA,  1990),  and  TR  350-70  -  Systems  Approach  to 
Training  Management,  Processes,  and  Products  (DA,  1999).  These  three  provide  the  Army 
policies  and  procedures  within  which  user-produced  TSP  development,  assessment,  and 
management  will  occur.  We  subsequently  identified  and  obtained  additional  documentation 
using  a  spiraling  approach  in  which  each  additional  document  would  point  to  several  others  that 
were  obtained  and  considered.  We  examined  ARI  reports,  especially  those  related  to  structured 
training  and  to  the  CITT  project;  documentation  describing  the  ATIA;  FMs  and  Mission 
Training  Plans  (MTPs);  general  references  on  simulation-based  training;  examples  of  contractor- 
and  user-produced  exercise  TSPs;  and  numerous  military  and  non-military  Internet  sites.  All 
together,  more  than  120  documents,  both  paper-based  and  electronic  were  examined;  a  complete 
list  is  included  in  Appendix  B. 

Approximately  60  days  into  the  project,  relevant  individuals  and  groups  whom  the  project 
team  wished  to  interview  were  identified.  Our  intent  was  to  talk  to  a  wide  variety  of  personnel 
who  play  a  role  in  exercise  and  TSP  development,  implementation,  assessment,  and  policy 
making.  Interviews  were  arranged  through  the  project  COR.  We  developed  a  set  of  interview 
guidelines  and  questions  that  served  as  the  basis  for  each  interview.  These  were  modified  as 
necessary  for  the  individual/group  being  interviewed.  The  interview  questions  related  to  four 
broad  areas  of  interest;  What  did  the  interviewees  think  of  the  basic  premise  of  users  developing 
TSPs  themselves?  What  components  should  a  user-produced  TSP  include?  How  should  user- 
produced  TSPs  be  assessed?  How  should  user-produced  TSPs  be  managed  and  distributed?  The 
interviews  were  loosely  structured  around  these  areas;  however,  they  were  conducted  more  as 
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group  discussions  than  question/answer  sessions.  Each  interview  was  conducted  by  at  least  two 
project  team  members  with  most  being  conducted  by  three  or  more.  The  same  team  member 
served  as  lead  interviewer  for  all  interviews,  although  all  members  asked  questions  as 
appropriate  at  any  time  during  the  interview.  All  interview  participants  were  told  that  any 
information  they  provided  was  not  for  attribution.  Each  team  member  took  notes  and  recorded 
his/her  observations.  Following  the  interview,  the  team  met  to  debrief  and  discuss  the  interview 
findings. 

We  conducted  a  total  of  28  interviews  (22  in  person;  six  by  telephone)  involving  a  total  of 
41  participants.  The  organizations  represented  by  the  participants  included  TOE  Army  units, 
TRADOC  Deputy  Chief  of  Staff  for  Training  (DCST),  Army  Training  Support  Center,  the 
Combined  Arms  Center,  Directorate  of  Training  and  Doctrine  Development  at  Fort  Knox,  CCTT 
and  Air  Network  (AirNET)  simulation  centers,  the  National  Training  Center,  a  training  support 
brigade,  a  non-commissioned  officer  academy,  an  observer/controller  (O/C)  team,  the  Force  XXI 
Systems  Engineering  and  Technical  Assistance  team,  and  the  contractor  team  developing  the 
CITT. 


TSP  Core  Set  Identification 

The  SOW  (ARI,  1999)  directed  the  project  team  to  explore  TSP  requirements  for  U.S.  Army 
combat  arms  units  at  brigade  and  below  through  the  year  2005.  We  interpreted  this  requirement 
as  having  two  components  -  development  of  a  process  for  identifying  core  sets  of  exercises  for 
various  organizations  and  identification  of  the  data  components  that  comprise  a  TSP4  for 
collective  training  exercises.  This  section  describes  the  core  set  identification  process. 

Core  sets  of  training  exercises,  even  if  not  by  name,  have  long  been  used  to  meet  the  basic 
training  needs  of  U.S.  armed  forces  (MTP  Situational  Training  Exercises  [STX]  for  example). 
The  concept  derives  from  the  premise  that  standardizing  doctrine,  and  thus  training,  clearly 
promotes  success  on  the  battlefield.  In  this  project,  concerns  about  training  utility  led  to  the 
conclusion  that  a  core  set  should  be  both  practical  -  addressing  the  real  needs  of  existing  units  - 
and  exemplary  -  providing  examples  from  which  units  can  model  their  own  TSPs.  In  addition, 
the  TSPs  in  the  core  set  should  provide  broad  mission  and  task  coverage,  serve  a  wide  audience 
of  units  within  the  unit  type,  and  adhere  to  the  principles  of  structured  training  described 
previously.  Thus,  the  core  set  is  defined  as  a  set  of  exercises  that  serves  the  basic  training  needs 
of  a  unit  by  providing  a  repository  of  training  exercises  from  which  units  can  select  those  that 
best  serve  their  needs.  It  is  important  to  note  that  the  core  set  does  not  specify  a  training 
strategy.  Rather,  exercises  in  the  core  set  need  to  support  any  training  strategies  that  may  be 
developed. 


4  The  terms  “exercise”  and  “TSP”  are  used  consistently  throughout  this  report  to  refer  to  similar,  although  not 
identical,  items.  An  exercise  is  the  actual  training  event  consisting  of  cues  or  stimuli,  unit  actions,  and  feedback. 
The  TSP  is  the  documentation  that  supports  the  conduct  of  the  exercise. 
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A  Process  for  Identifying  Core  Set  Exercises 

The  project  team  set  out  to  develop  a  logical,  systematic  process  for  specifying  collective 
structured  training  exercises  that  would  comprise  a  core  set.  It  is  important  to  emphasize  that  the 
process  is  not  a  means  of  developing  training,  but  rather  a  way  to  determine  what  training  should 
be  developed.  The  process  systematically  identifies  the  structured  training  exercises  that  might 
comprise  a  core  set;  it  does  not  include  their  development.  To  accomplish  this,  the  process 
identifies  potential  training  methods  and  training  content.  It  then  matches  the  methods  with 
content  based  on  value-related  criteria  residing  in  such  questions  as:  Is  the  training  general 
enough  to  serve  the  needs  of  a  majority  of  units  within  the  unit  type?  Do  the  expected  benefits 
of  a  given  piece  of  training  justify  the  expense  of  the  TADSS  employed? 

The  process  begins  by  considering  a  broad  domain  of  potential  training  and  narrows  that 
domain  into  a  smaller,  more  concentrated  set  of  training  alternatives  using  the  five  steps  shown 
in  Figure  3.  Before  describing  these  steps,  several  points  need  to  be  addressed.  First,  following 
the  process  will  lead  to  “a”  core  set,  not  “the”  core  set.  There  is  no  single  solution.  Different 
individuals  will  identify  different  exercises  for  the  core  set  based  upon  their  expertise, 
experience,  and  viewpoints.  Second,  it  is  important  to  remember  that  the  process  results  in  the 
identification  of  the  exercises  that  could  comprise  the  core  set.  Producing  an  actual  core  set  of 
TSPs  requires  the  additional  activities  of  designing  exercises  and  producing  the  TSPs.  These 
activities  require  in-depth  analyses  of  training  needs,  training  options,  and  development 
capabilities. 

Step  1.  Specify  Unit  Type.  In  step  1  the  unit  type  for  which  a  core  set  will  be  developed  is 
specified.  Unit  types  are  defined  by  branch  and  echelon,  and  each  specific  unit  type  will  have  its 
own  core  set  of  training  exercises.  In  the  actual  core  set  identification,  analysts  would  begin  with 
the  unit  type  as  a  given  -  they  would  know,  for  example,  that  they  were  developing  a  core  set 
specification  for  a  tank  battalion  or  a  rifle  platoon.  The  fact  that  there  is  no  analysis  required  is 
illustrated  by  the  broken  line  around  Step  1  in  Figure  3. 

Step  2.  Select  Viable  Training  Methods.  In  step  2  the  viable  training  methods  for  a  given 
unit  type  are  selected.  A  training  method  is  defined  as  a  specific  exercise  type  being  conducted 
in  a  specific  training  environment.  An  STX-Live  and  Map  Exercise  (MAPEX)-Constructive  are 
examples  of  training  methods.  To  identify  viable  training  methods,  one  needs  to  begin  with  the 
domain  of  all  conceptually  possible  training  methods.  This  domain  consists  of  all  training 
methods  that  could  occur  even  though  some  are  illogical,  impractical,  or  even  physically 
impossible  to  implement.5  Considering  all  the  training  methods,  however,  reduces  the 
probability  that  someone  attempting  to  specify  core  set  exercises  for  a  unit  would  inadvertently 
omit  ones  that  should  be  included. 


5  There  are  numerous  examples  of  exercises  that  are  not  clearly  logical,  practical,  or  possible:  An  armor  platoon 
STX  conducted  in  constructive  simulation  is  illogical  and  physically  impossible.  An  infantry  brigade  MAPEX 
conducted  in  constructive  simulation  is  impractical.  An  armor  brigade  field  training  exercise  (FTX)  conducted  in 
the  virtual  simulation,  CCTT,  is  physically  impossible  due  to  the  number  of  simulators  the  exercise  would  require. 
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Figure  3.  The  core  training  support  package  set  identification  process. 

The  domains  of  all  possible  training  methods  identified  for  Armor  and  Mechanized  Infantry 
units,  based  on  exercise  types  identified  in  FM  25-101  (DA,  1990),  are  illustrated  in  Figure  4. 
Similar  domain  identification  could  easily  be  completed  for  other  unit  types.  (We  recognize  that 
technological  advancements  are  increasing  the  flexibility  and  interoperability  of  the  Army’s 
simulations,  and  that  additional  exercise  types,  especially  ones  combining  the  various 
environments  will  be  developed  in  the  future.  This  could  affect  the  domain  of  possible  training 
methods  depending  upon  factors  that  exist  at  the  time  a  core  set  is  specified.) 

To  complete  Step  2,  the  analyst  selects  the  appropriate  row  of  the  matrix,  and  for  each  of  the 
potential  training  methods  represented  by  the  cells  in  the  row,  poses  three  questions:  Does  the 
exercise  type  fit  the  echelon?  Does  the  environment  support  the  exercise  type?  Is  the  exercise 
type  efficient  in  that  environment?  Examples  of  rationales  that  further  illustrate  how  these 
questions  would  be  considered  are  presented  in  Table  1 .  Exercises  that  do  not  meet  the  criteria 
are  dropped  from  future  consideration  as  training  methods  appropriate  for  the  core  set.  Those 
remaining  are  retained  for  further  analysis. 
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Figure  4.  Matrix  of  possible  training  methods  for  armor  and  mechanized  infantry  units. 

To  illustrate  Step  2,  the  project  team  used  the  above  questions  to  determine  the  viability  of 
training  methods  for  armor  units.  This  process  filtered  out  those  techniques  that  did  not  meet  the 
proposed  criteria  for  one  reason  or  another.  The  result  of  this  analysis  is  shown  in  Figure  5 
where  cells  containing  a  indicate  viable  training  methods. 
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Figure  5.  Viable  training  methods  for  armor  units. 

Step  3.  Identify  Training  Focus.  Step  3  of  the  process  begins  to  identify  the  actual  content 
of  the  core  set  by  identifying  tasks  and  task  sequences  upon  which  the  core  set  will  focus,  and  by 
grouping  them  into  realistic  storylines.  In  later  steps,  this  information  will  be  combined  with  the 
results  of  Step  2  to  identify  the  specific  exercises  that  will  comprise  the  core  set.  Step  3  begins 
by  establishing  the  domain  of  potential  training  content;  it  then  filters  and  organizes  that  content 
to  generate  a  list  of  training  topics.  These  topics  maximize  the  utility  of  the  core  set  of  TSPs  by 
directing  attention  to  critical  and  frequently  performed  missions  and  tasks. 
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Table  1 


Sample  Rationales  for  Determining  the  Viability  of  Training  Methods 
Criteria  Sample  Rationales 


Does  the  exercise 
type  fit  the 
echelon? 


>  The  FTX  is  intended  for  battalion  and  brigade  echelon  training,  but  not  for 
company  and  platoon. 

>  The  STX  is  intended  for  company  and  platoon  echelon  training,  but  not  for 
battalion  and  brigade. 

>  The  CFX  is  intended  for  battalion  and  brigade  echelon  training,  but  not  for 
company  and  platoon. 


Does  the 
environment 
support  the 
exercise? 


>  CCTT  can  support  exercises  such  as  a  company  STX,  a  brigade  CFX,  and  a 
battalion  FTX  because  there  are  sufficient  simulators  for  the  number  of 
participants  involved. 

>  CCTT  should  not  be  used  to  support  a  battalion  CPX  because  the  staff 
participants  in  this  exercise  do  not  require  CCTT’s  virtual  portrayal  of  the 
battlefield. 


Is  the  exercise 
efficient  in  the 
environment? 


>  The  live  training  environments,  or  ranges,  as  they  currently  exist  are  not  large 
enough  or  intended  for  a  brigade  level  LFX;  these  ranges,  however,  are  used  to 
enable  the  LFX  at  the  company  and  platoon  echelons. 

>  The  MAPEX  is  more  efficiently  conducted  in  a  live  environment  (i.e.,  using  a 
paper  map)  than  in  a  constructive  environment.  Constructive  simulations 
require  resources  and  detailed  coordination  that  are  not  needed  in  the  live 
setting.  There  are  advantages  to  utilizing  constructive  simulation  for  MAPEX- 
like  training;  however,  these  events  more  closely  resemble  wargaming 
operations  and  are  better  classified  as  CPX  training. 

>  It  is  far  more  efficient  for  a  brigade  to  conduct  a  CPX  in  constructive 
simulation  than  it  is  for  a  brigade  to  execute  a  completely  live  CPX.  It  is  far 
more  efficient  to  use  constructive  simulation  to  assess  casualties,  compute 
movement  times,  and  account  for  environmental  factors,  than  it  is  to  use  the 
myriad  of  controllers  a  completely  live  CPX  would  require. 

>  A  battalion  FCX  with  the  narrow  objective  of  improving  the  battalion’s  ability 
to  shift  the  priority  of  mortar  fires  is  more  efficiently  conducted  in  virtual, 
rather  than  in  a  live  simulation  due  to  the  great  expense  associated  with 
executing  the  tasks  live. 


Note.  CCTT  =  Close  Combat  Tactical  Trainer;  CFX  =  command  field  exercise;  CPX  =  command  post  exercise; 
FCX  -  fire  control  exercise;  FTX  =  field  training  exercise;  LFX  =  live  fire  exercise;  MAPEX  =  map  exercise; 
STX  =  situational  training  exercise. 


Consistent  with  Army  doctrine  that  training  be  task-based,  it  makes  sense  to  identify  the 
initial  domain  of  training  content  in  terms  of  the  tasks  performed  by  the  unit  type  for  which  the 
core  set  is  being  specified.  Our  recommendation,  at  least  at  this  time,  is  to  start  with  the 
appropriate  MTP  that  specifies  the  collective  tasks  as  well  as  leader  tasks  and  supporting 
individual  tasks.  Other  sources,  such  as  the  Army  Universal  Task  List  (DA,  2000b),  which  is 
under  development,  may  eventually  provide  a  more  comprehensive  and  useful  documentation  of 
training  requirements.  This  overall  domain  of  training  requirements  (tasks)  is  filtered  to  identify 
those  upon  which  training  should  actually  focus  by  asking  the  following:  Should  this  task  be  the 
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focus  of  an  exercise  or  will  it  be  trained  more  efficiently  in  the  context  of  another  task?  This 
identifies  the  tasks  which  will  become  the  focus  of  the  core  set.  An  example  of  this  activity, 
completed  for  a  tank  platoon,  is  shown  in  Figure  6. 


AftTEP  17-237-10-1 


MISSION  TRAINING  PLA 
FOR  THE 
tank  platoon 


ofth*  Army 


July  199G 


Tank  Platoon  Tasks 

Conduct  Troop-Leading  Procedures 

Conduct  Assembly  Area  Activities 

Conduct  Linkup 

Establish  an  Observation  Post 

Conduct  Bypass  Operations 

Conduct  Convoy  Escort 

Coordinate/Conduct  a  Passage  of  Lines  Forward/Rearward 

Conduct  Tactical  Movement 

Conduct  a  Tactical  Road  March 

Execute  Actions  on  Contact 

Destroy  an  Inferior  Force 

Assault  an  Enemy  Position 

Conduct  an  Attack  by  Fire 

Conduct  Overwatch/Support  by  Fire 

Conduct  Reconnaissance  by  Fire 

Follow  and  Support 

Coordinate/Assista  Passage  of  Lines  Forward/Rearward 

Disengage  from  the  Enemy 

Conduct  a  Deliberate  Occupation  of  a  Platoon  Battle  Position 

Conduct  Hasty  Occupation  of  a  Platoon  Battle  Position 

Conduct  a  Perimeter  Defense 

Conduct  a  Platoon  Defense 

Conduct  a  Relief  in  Place 

Displace  to  a  Successive/Alternate  Platoon  Battle  Position 

Conduct  Breach  Force  Operations 

Conduct  Operational  Decontamination 

Cross  an  NBC  Contaminated  Area 

Emplace  and  Retrieve  a  Hasty  Obstacle 

Conduct  Passive  Air  Defense  Measures 

Conduct  Consolidation  and  Reorganization  Activities 

Conduct  Resupply  Operations 

Selection  Criteria 

p  Would  You  Develop  an  Exercise 
Specifically  to  Train  the  Task? 

jp  Could  this  Task  be  More  Efficiently 
Trained  in  the  Context  of  Another 
Task? 


.  Focus  Tank  Platoon  Tasks 

Conduct  Linkup 

Conduct  Bypass  Operations 

Conduct  Convoy  Escort 

Coordinate/Conduct  a  Passage  of  Lines  Forward/Rearwa  rd 

Destroy  an  Inferior  Force 

Assault  an  Enemy  Position 

Conduct  an  Attack  by  Fire 

Conduct  Overwatch/Support  by  Fire 

Disengage  from  the  Enemy 

Conduct  a  Deliberate  Occupation  of  a  Platoon  Battle  Position 

Conduct  Hasty  Occupation  of  a  Platoon  Battle  Position 

Conduct  a  Platoon  Defense 

Displace  to  a  Successive/Altemate  Platoon  Battle  Position 

Conduct  Breach  Force  Operations 

Conduct  Operational  Decontamination 

Conduct  Consolidation  and  Reorganization  Activities 

Conduct  Resupply  Operations 

Figure  6.  An  example  of  task  filtering  for  a  tank  platoon. 

As  illustrated  in  this  figure,  the  tank  platoon  MTP  was  used  to  derive  the  collective  tasks 
that  comprise  the  potential  training  domain  for  the  tank  platoon  core  set.  Each  task  was 
examined  in  light  of  the  specified  filters  to  produce  the  reduced  list  of  tasks  shown.  These  tasks 
serve  as  the  training  content  upon  which  the  core  set  focuses.  It  is  important  to  point  out, 
however,  that  even  though  some  tasks  are  not  selected  as  focus  tasks,  this  does  not  mean  that 
they  will  not  be  included  in  the  training.  It  simply  means  that  they  will  be  trained  in  the  context 
of  an  exercise  that  focuses  on  another  task.  In  the  example  shown,  “Conduct  Troop-Leading 
Procedures”  was  not  selected  as  a  focus  task  since  it  will  be  trained  in  the  context  of  virtually 
every  exercise.  Similarly,  “Conduct  Tactical  Movement”  can  be  trained  within  the  context  of 
exercises  that  focus  on  broader  tasks,  such  as  “Assault  an  Enemy  Position.” 

Once  the  tasks  upon  which  the  core  set  will  focus  have  been  identified,  the  next  activity  is  to 
group  them  into  doctrinally  sound  combinations  that  can  be  sequenced  into  realistic  battlefield 
storylines.  Consistent  with  the  Army’s  “train  as  you  fight”  ethos,  storylines  must  reflect  the 
manner  in  which  events  truly  unfold  on  the  battlefield.  This  activity  is  somewhat  subjective,  and 


14 


there  is  no  single,  correct  outcome.  We  have,  however,  developed  guidelines  to  assist  its 
completion. 

First,  analyze  the  tasks  to  determine  how  they  actually  occur  in  battlefield  conditions.  This 
selects  those  tasks  that  reflect  broad  and  commonly  trained  missions.  Next,  analyze  the  tasks  for 
possible  groupings  that  can  be  trained  together.  The  identified  missions  and  other  task  groupings 
are  then  used  to  create  realistic  training  scenarios.  Keep  in  mind  that,  at  this  point,  training 
method  is  not  yet  a  factor  in  the  analysis.  Allowing  the  training  method  (the  simulation 
environment  and  exercise  type)  to  qualify  decisions  that  detennine  storyline  structure  will  create 
storylines  that  are  artificial  to  the  extent  that  the  training  method  constrains  battlefield  conditions 
and  performance.  This  will  cause  difficulties  in  mapping  storylines  onto  training  methods  in 
Step  5.  An  example  of  this  activity,  again  using  the  tank  platoon,  is  shown  in  Figure  7. 


.  Focus  Tank  Platoon  Tasks 

Conduct  Linkup 

Conduct  Bypass  Operations 

Conduct  Convoy  Escort 

Coordinate/Conduct  a  Passage  of  Lines  Fonvard/Rearward 

Destroy  an  Inferior  Force 

Assault  an  Enemy  Position 

Conduct  an  Attack  by  Fire 

Conduct  Overwatch/Support  by  Fire 

Disengage  from  the  Enemy 

Conduct  a  Deliberate  Occupation  of  a  Platoon  Battle  Position 

Conduct  Hasty  Occupation  of  a  Platoon  Battle  Position 

Conduct  a  Platoon  Defense 

Displace  to  a  Successive/Alternate  Platoon  Battle  Position 

Conduct  Breach  Force  Operations 

Conduct  Operational  Decontamination 

Conduct  Colts olidation  and  Reorganization  Activities 

Conduct  Resupply  Operations 

Group  Tasks  into  Storylines 

f|  Identify  How  Tasks  Actually  Occur 
jj  Identify  Tasks  that  Can  Be  Trained  Together 
§  Group  Tasks  to  Create  Realistic  Scenarios 


Conduct  Area  Security  Operations 
Conduct  Convoy  Escort 


Figure  7.  An  example  of  identifying  storylines  for  a  tank  platoon. 

As  this  example  illustrates,  the  1 6  tasks  selected  during  the  previous  activity  were  analyzed 
to  create  a  more  limited  number  of  storylines  for  the  core  set.  Most  of  the  tasks  could  have  been 
trained  as  stand-alone  operations  and  can  represent  entire  storylines  resulting  in  a  large  number 
of  exercises.  Applying  the  specified  guidelines,  however,  allowed  the  tasks  to  be  grouped  into 
storylines,  examples  of  which  are  shown. 

Step  4.  Identify  Specifications  for  Collective  Training.  Step  4  identifies  specifications  for 
core  set  training  by  assigning  training  methods  to  the  storylines  identified  in  the  previous  step. 

At  this  point,  we  are  still  not  identifying  specific  exercises;  rather,  we  are  broadly  specifying  the 
types  of  exercises  that  would  be  appropriate  for  each  storyline.  To  accomplish  this,  one  analyzes 
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the  storylines  to  identify  which  of  the  viable  training  methods  are  appropriate  for  each.  The 
decisions  rest  upon  how  well  the  environment  and  type  of  exercise  support  training  of  the  tasks 
included  in  the  storyline  considered.  This  analysis  boils  down  to  two  questions:  Does  the 
training  method  support  the  tasks  to  be  trained?  Will  the  resulting  training  be  efficient? 
Answering  these  questions  entails  deciding  how  effectively  the  tasks  can  be  trained  in  a  given 
TADSS  environment6  and  whether  the  training  is  the  best  way  to  accomplish  the  training 
objectives.  For  each  storyline,  the  answers  to  these  questions  will  determine  which  training 
methods  the  core  set  should  employ  to  train  that  content,  thereby  determining  the  specifications 
for  core  set  training.  An  example  of  the  results  of  completing  Step  5  for  tank  platoon  storylines 
is  shown  in  Figure  8. 


Storyline  Grouping 


Training  Methods 


Conduct  a  Hasty  Occupation  of  a  Platoon  BP 
I  Conduct  a  Platoon  Defense 


STX  -  LIVE 
LCX  -  LIVE 
LFX  -  LIVE 
STX  -  CCTT 


Conduct  Breach  Force  Operations 
Assault  an  Enemy  Position 
Conduct  an  Attack  By  Fire 


MAPEX  -  LIVE 
STX  -  LIVE 
STX  -  CCTT 


Conduct  Area  Security  Operations 
Conduct  Convoy  Escort 


STX-  LIVE 
STX-  CCTT 


Figure  8.  An  example  of  identifying  specifications  for  collective  training  for  a  tank  platoon. 

As  illustrated,  the  analysis  of  the  storylines  for  the  tank  platoon  identifies  the  specific 
training  methods,  in  terms  of  exercise  type  and  environment,  that  are  likely  to  be  effective  and 
efficient  in  training  the  storyline.  The  exercise  types  are  ones  that  were  found  to  be  viable  in 
Step  3  for  the  live  or  virtual  environments.  No  constructive  training  had  been  deemed  viable. 

Step  5.  Identify  Core  TSP  Set.  The  final  step  in  the  process  of  developing  a  core  set  of 
TSPs  entails  specifying  the  actual  set  of  exercises  and  TSPs  that  reflects  the  results  of  Steps  1 


6  Burnside  (1990)  provides  a  method  for  making  a  task-by-task  assessment  of  which  collective  tasks  can  be 
performed  in  a  given  simulation  environment.  The  work  dealt  specifically  with  selecting  MTP  tasks  for  the 
Simulation  Networking  (SIMNET)  system  (Alluisi,  1991).  However,  the  method  could  be  used  to  produce  an  index 
of  training  fidelity  for  each  task  performed  in  any  given  TADSS. 
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through  4.  This  specification  is  based  on  practical  considerations  that  occur  at  the  time  the 
specification  is  made,  such  as  availability  of  exercise  development  resources  and  consideration 
of  the  most  pressing  needs  of  the  unit  type  for  which  the  core  set  is  being  developed.  Ultimately, 
the  goal  is  to  develop  exercises  for  all  of  the  core  set  training  specifications  identified  in  Step  4. 

It  may,  however,  be  impractical  to  accomplish  this  all  at  once.  In  any  event,  this  step  turns  the 
general  specifications  of  Step  5  into  specific  exercises.  That  is,  for  each  training  method  and 
storyline  considered  by  the  process,  a  list  of  exercises  that  trains  them  is  developed  and 
specified.  Figure  9  shows  the  outcome  of  Step  5  for  one  of  the  storylines  of  the  tank  platoon. 

The  storyline  has  been  named  “Deliberate  Attack,”  and  one  possible  grouping  of  exercises  to 
train  it  is  shown.7 


Figure  9.  An  example  of  specifying  core  set  training  support  packages  for  a  tank  platoon. 

TSP  Component  and  Element  Identification 

The  second  aspect  of  the  SOW’s  direction  to  explore  TSP  requirements  for  U.S.  Army 
combat  arms  units  at  brigade  and  below  through  the  year  2005  is  the  identification  of  the  data 
components  that  comprise  a  TSP  for  collective  training  exercises.  For  the  purposes  of  this 
project,  data  components  refer  to  the  information  items  that  make  up  the  TSP  as  opposed  to  the 
contents  of  those  items.  Component  identification  is  critical  to  future  Army  training  in  a  number 
of  ways.  First,  the  components  themselves  must  support  structured  training  as  it  has  evolved 
over  the  past  decade  (Campbell  et  al.,  2000).  Thus,  the  information  in  the  TSP  must  support  the 
identification  of  the  stimuli  or  cues  that  elicit  collective  task  and  supporting  individual  task 
performance  and  the  performance  feedback  that  is  vital  to  structured  training.  Second,  the  use  of 


7  It  would  have  been  equally  feasible  to  break  the  STX-Live  Deliberate  Attack  exercise  into  smaller  exercises  as  was 
done  for  the  STX-CCTT.  The  breakdown  shown  represents  one  way  to  break  out  the  training.  This  further 
illustrates  that  there  is  no  single  correct  “solution”  to  core  set  identification. 


17 


a  common  set  of  TSP  components  will  facilitate  sharing  TSPs  since  users  will  be  familiar  with 
and  have  a  common  understanding  of  the  information  in  the  TSP.  Similarly,  it  will  facilitate 
exercise  execution  in  that  the  various  personnel  involved  in  executing  an  exercise  will  also  have 
a  common  understanding.  Finally,  having  a  commonly  accepted  set  of  TSP  components  will 
facilitate  the  development  of  the  user  tools  or  applications  that  comprise  the  ATIA  since  several 
of  the  Automated  Information  Systems  identified  therein  will  employ  TSPs,  both  proponent-  and 
user-developed. 

Before  beginning  the  discussion  of  how  the  project  team  developed  the  TSP  component 
listing  produced  in  this  project,  several  clarifying  points  need  to  be  made.  First,  we  had  no 
preconceived  ideas  concerning  whether  a  single  set  of  components  or  different  sets  would  be 
needed  for  TSPs  developed  for  different  exercises.  Can  the  same  set  of  components  support 
exercises  for  different  training  methods  and  environments  and  different  TADSS  or  are  the 
differences  so  great  as  to  require  different  sets?  Second,  we  recognized  the  need  to  develop  the 
component  set  independent  of  any  single  user  of  the  TSP.  If  we  were  to  identify  all  required 
components,  we  needed  to  be  mindful  of  all  potential  TSP  users.  Finally,  we  needed  to  identify  a 
component  to  a  level  that  would  support  development  of  database  specifications  for  it.  Although 
it  was  not  our  task  to  develop  the  actual  database  specifications,  for  the  components  to  have 
utility,  they  must  be  at  a  sufficiently  detailed  level  so  that  specifications  can  be  developed.8  This 
is  particularly  critical  to  support  future  training  systems  as  outlined  in  the  ATIA. 

The  TSP  Component  Identification  Process 

Figure  10  depicts  the  process  the  team  employed  to  identify  the  components  of  a  TSP  for  a 
collective  training  exercise.  While  the  process  is  shown  as  five  discrete  steps  leading  to  the 
development  of  the  list,  in  actuality  there  was  a  great  deal  of  overlap.  We  were  continuously 
going  back  and  revising  earlier  products  (TSP  component  names  and  definitions)  based  on 
identifying  and  delineating  other  components  and  definitions.  However,  for  presentation 
purposes,  it  is  less  confusing  to  think  in  terms  of  the  steps  shown. 

The  foundation  of  the  process  was  data  collection  which  continued  throughout.  As 
described  in  the  data  collection  section,  this  activity  consisted  of  obtaining  and  examining 
relevant  documentation,  interviewing  military,  government,  and  civilian  personnel  involved  in 
collective  training,  and  in  examining  examples  of  TSPs  produced  by  units,  training  support  units, 
and  contractors.  Altogether,  a  total  of  16  TSPs  were  obtained  and  examined9.  Of  the  16,  7  were 
designed  for  live  exercises,  6  for  constructive  exercises,  and  3  for  virtual  exercises.  The  key 
Army  documents  related  to  TSP  components  are  TR  350-70  Systems  Approach  to  Training 
Management,  Processes,  and  Products  (DA,  1999)  and  Training  Circular  (TC)  25-10  A  Leader’s 
Guide  to  Lane  Training  (DA,  1996a).  We  also  obtained  and  examined  the  Army’s  Automated 


8  As  used  in  this  report,  database  specification  refers  to  defining  the  data  type  for  each  element  and  determining 
table  structures  and  relationships. 

9  The  TSPs  examined  represent  a  broad  range  of  user-  and  contractor-produced  TSPs  without  allowing  any 
particular  type  to  dominate.  For  example,  although  we  had  access  to  numerous  Simulation  Networking  (SIMNET) 
and  CCTT  exercise  TSPs,  only  one  was  included  in  the  1 6  that  were  examined. 
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Systems  Approach  to  Training  software  and  the  Standard  Army  Training  System  (SATS) 
software.  Both  include  TSP  development  functions  and,  therefore,  provide  a  specification  of  the 
TSP  components  included  in  each. 


Step  5.  Organize 
TSP  Components  & 
Elements 


Step  4.  Refine  Definitions 
of  TSP  Components  & 
Elements 


Collective  TSP 
Component  & 
Element  List 


Step  3.  Decompose 
TSP  Components  & 
Elements 


Step  2.  Generate  a  List 
of  TSP  Components 


Step  1.  Analyze  Doctrine 
&  Training  Materials 


Figure  10.  The  training  support  package  component  identification  process. 

The  TR  350-70  (DA,  1999)  provides  a  well-conceptualized  model  of  TSP  components  for 
collective  TSPs,  termed  Warfighter  TSPs  in  the  regulation.  The  range  of  components 
theoretically  covers  the  full  array  of  those  required  by  the  various  exercise  types  and 
environments,  but  at  a  fairly  high  level.  The  components  are  specified  in  very  general  terms  that 
collapse  across  numerous,  more  specific  “sub-components,”  and  it  is  these  sub-components  that 
would  be  required  to  produce  the  precision  necessary  to  develop  database  specifications.  The 
component  list  from  TR  350-70  is  included  in  Appendix  C. 

The  TC  25-10  (DA,  1996a)  deals  strictly  with  lane  training  exercises  and  does  not  address 
the  other  types  of  exercises  that  figure  prominently  in  the  present  effort  to  identify  TSP 
components.  The  training  circular  was  of  value  primarily  in  that  it  provided  a  time-tested, 
doctrinal  model  of  a  TSP  which  provided  a  second  source  for  comparison  to  other  doctrinal 
sources  and  to  the  example  TSPs  obtained.  The  listing  of  components  contained  in  TC  25-10  is 
included  in  Appendix  D. 
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Step  1.  Analyze  Doctrine  and  Training  Materials.  As  shown  in  Figure  10,  the  first  activity 
of  the  process  was  to  analyze  the  various  doctrinal  and  TSP  materials.  This  was  accomplished 
by  “crosswalking”  the  various  sources  against  one  another.  The  TR  350-70  (DA,  1999)  was 
compared  to  TC  25-10  (DA,  1996a)  to  determine  components  common  to  both  or  unique  to  one 
or  the  other.  The  TR  350-70  was  also  compared  to  the  example  TSPs  using  the  same  method.  In 
both  instances,  it  proved  difficult  to  make  comparisons  with  a  great  degree  of  confidence 
because  of  the  different  names  used  as  well  as  the  differences  in  level  of  specificity  employed. 
Sample  TSP  components  of  even  similar  natures  and  functions  exhibited  great  variance.  In  the 
end,  we  determined  that  every  sample  TSP  contained  components  that  conformed,  to  a  greater  or 
lesser  degree,  with  those  of  the  TR  350-70  and  TC  25-10  models,  and  there  were  many 
components  that  simply  didn’t  conform  to  the  models  at  all.  Based  on  the  comparison,  however, 
we  were  able  to  develop  our  initial  list  of  TSP  components  which  provided  the  starting  point  for 
the  remainder  of  the  components  identification  process. 

Step  2.  Generate  a  List  of  TSP  Components.  With  the  list  produced  in  the  above  activity  as 
a  starting  point,  the  project  team  began  to  identify  a  comprehensive  list  of  TSP  components 
based  on  its  own  combined  knowledge  and  experience  in  collective  training  in  a  variety  of 
environments.  Components  were  identified  without  reference  to  any  specific  user  of  the  TSP, 
although  this  sometimes  proved  difficult.  We  also  made  no  distinction,  at  this  time,  between 
components  for  live,  virtual,  or  collective  exercises  —  we  simply  set  out  to  list  all  of  them.  In 
fact,  it  was  during  this  activity  that  we  began  to  think  seriously  about  the  possibility  that  a  single 
component  list  might  apply  to  all  TSPs  in  all  environments. 

The  actual  process  of  developing  and  refining  the  component  list  involved  a  series  of 
“brainstorming”  sessions  involving  all  of  the  team  members.  Components  were  proposed, 
named,  modified,  renamed,  remodified,  and  decomposed  into  smaller  components  in  an  effort  to 
produce  a  comprehensive  list.  This  process  was  repeated  over  the  course  of  numerous  sessions 
resulting  in  the  list  that  served  as  the  basis  for  the  next  activity. 

Step  3.  Decompose  TSP  Components  and  Elements.  During  this  activity,  the  project  team 
began  to  consider  the  components  from  the  standpoint  of  how  they  would  be  “databased”;  that  is, 
for  each  component,  we  asked  the  question:  Is  this  component  identified  at  a  level  sufficient  to 
allow  it  to  be  specified  in  terms  of  designing  a  database  of  components?  It  was  while  completing 
this  activity  that  the  project  team  began  to  see  that  some  of  our  previously  identified  components 
actually  consisted  of  multiple  components  from  a  database  standpoint.  This  helped  our  further 
refinement  of  the  list  and  led  to  a  slight  change  in  terminology.  We  continued  to  use  the  term 
component;  however,  it  came  to  signify  a  group  of  TSP  elements.  The  term  “element”  was  used 
to  indicate  a  piece  of  a  TSP  that  had  been  identified  at  a  level  sufficient  to  develop  database 
specifications  for  it.  This  does  not  imply  that  the  element  consists  of  a  single  datum;  it  simply 
means  that  there  is  no  reason  to  decompose  it  further  to  use  it  in  a  user  tool  or  application. 

This  activity  was  conducted  for  all  of  the  components  identified  previously  leading  to  a 
refined  list  that  consisted  of  components  and  elements.  It  also  marked  the  end  of  the  actual 
identification  process;  remaining  activities  were  directed  at  providing  further  definition  or 
organization  of  the  components  and  elements. 
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Step  4.  Refine  Definitions  ofTSP  Components  and  Elements.  The  next  step  in  the 
identification  process  was  to  review  each  component  and  element  identified  and  produce  a 
concise  definition  or  description  of  it.  The  purpose  of  this  activity  was  to  define  the 
components/elements  from  the  standpoint  of  the  TSP  users,  which  required  a  broader  perspective 
than  from  the  standpoint  of  the  project  team  alone.  This  step  served  two  important  functions. 
First,  producing  a  commonly  agreed-upon  definition  significantly  clarified  many  of  the 
components/elements.  Often  members  of  the  project  team  would  have  slightly  different 
connotations  for  a  particular  element,  which  were  not  apparent  until  this  step.  Coming  to  an 
agreed-upon  definition  or  description  helped  focus  our  thinking.  It  also  helped  to  further  identify 
elements  since,  occasionally,  the  discussion  of  a  component  or  element  would  make  it  clear  that 
we  were  dealing  with  more  than  one. 

The  result  of  this  step  was  a  component/element  list  that  satisfied  the  requirements  of  the 
project.  The  list  was  not,  however,  organized  in  any  particular  manner,  and  the  team  realized 
that  some  organization  would  be  helpful  for  presentation  of  the  list  to  interested  stakeholders. 
This  was  the  function  of  the  next  activity. 

Step  5.  Organize  TSP  Components  and  Elements.  The  final  activity  of  the  TSP  components 
identification  process  was  to  group  the  components  and  elements  identified  to  this  point  to 
facilitate  their  presentation  to  various  interested  parties.  After  examining  existing  categorization 
schemes,  such  as  that  in  TR  350-70  (DA,  1999),  the  team  decided  to  place  the 
components/elements  in  categories  related  to  their  function  in  an  exercise.  As  with  previous 
activities,  this  was  difficult  to  do  without  reference  to  a  particular  user.  However,  in  the  end,  we 
were  able  to  produce  a  categorization  scheme  that  serves  all  users  and  that  will  assist  in  the 
development  of  the  user  tools  and  applications  discussed  later  in  this  report.  The  list  ofTSP 
components  and  elements  is  shown  in  Figure  1 1 .  (The  complete  list  including  definitions  and 
examples  is  included  in  this  report  as  Appendix  E.) 

Validation  of  the  TSP  Component  and  Element  List 

Validation  of  the  project’s  list  ofTSP  components  included  several  reviews  to  verify  that 
the  list  ofTSP  components  meets  the  specifications  for  its  design,  and  that  it  has  utility. 

The  first  review  examined  whether  the  list  produced  is  consistent  with  current  Army  TSP 
documentation.  Consistency  does  not  mean  that  the  components  mirror  other  Army  lists  either 
in  components  included  or  organization;  rather,  it  means  that  our  list  accounts  for  all  the 
functions  served  by  the  components  in  the  Army  lists.  To  make  this  verification,  the  project 
team  conducted  crosswalks  that  compared  the  project  list  with  the  lists  provided  by  TR  350-70 
(DA,  1999)  and  TRADOC’s  Train  the  Force  Integrated  Definition  Model:  Create  Collective 
War  Fighter  Training  Support  Packages  (DA,  1996b).  Each  crosswalk  showed  that  we  covered 
the  intended  functions  of  the  Army  lists,  and  no  revisions  were  made  based  on  this  limited 
review.  The  results  of  these  crosswalks  are  contained  in  Appendixes  F  and  G  respectively. 
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(figure  continues) 


Figure  1 1 .  TSP  components  and  elements. 
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Figure  1 1  (continued).  TSP  components  and  elements. 
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The  next  review  examined  whether  the  components  and  elements  fit  all  exercise  types  and 
environments,  and  whether  they  worked  for  all  TSP  users.  The  team  produced  charts  showing 
which  components  were  required  by  exercise  type  and  environment  and  by  TSP  user.  These 
were  employed  as  the  basis  of  a  subject  matter  expert  (SME)  review  using  military  and 
contractor  personnel  who  have  extensive  experience  in  collective  training  including  members  of 
the  Force  XXI  Systems  Engineering  and  Technical  Assistance  Team  at  Fort  Knox.  For  each 
exercise  type  and  environment,  SMEs  walked  through  the  list  of  components,  judging  the 
appropriateness  of  each  component  for  that  type  of  exercise.  They  then  attempted  to  identify 
unlisted  components  that  might  be  required  in  such  an  exercise.  This  review  produced  a  limited 
number  of  revisions10  to  the  component  list.  More  importantly,  it  confirmed  the  team’s  growing 
realization  that  the  complete  list  provides  all  of  the  components  and  elements  needed  for  TSPs 
for  exercise  types  and  environments  that  fall  within  the  scope  of  the  project.  That  is,  there  is 
sufficient  commonality  that  the  same  master  list  of  TSP  components  and  elements  will  work  for 
all  exercise  types  and  all  environments.  This  is  not  to  say  that  every  component  or  element  is 
required  for  every  exercise  type  or  environment;  rather,  there  is  enough  commonality  to  justify 
using  the  same  list  for  all.  In  the  end,  depending  upon  exercise  type  and  environment,  there  may 
be  some  components  or  elements  that  are  not  required  for  a  particular  instance;  however,  in  this 
case,  there  will  simply  be  no  data  required  for  those  fields.  This  should  greatly  simplify  database 
development  in  support  of  the  ATIA. 

As  a  final  validation  of  the  TSP  component  and  element  list,  the  project  team  presented  a 
briefing  on  the  list  to  personnel  from  DCST  (Training  Development  and  Analysis  Directorate), 
the  Army  Training  Support  Center,  DCST-West  (Collective  Training  Directorate),  and  U.S. 
Army  Simulation,  Training  and  Instrumentation  Command.  Because  of  the  large  amount  and 
complexity  of  the  information  to  be  reviewed,  the  list  of  components  and  their  descriptions  were 
provided  to  reviewers  one  week  in  advance  of  face-to-face  feedback  sessions. 

This  review  focused  primarily  on  utilization,  but  also  revealed  the  need  to  reexamine  the 
comprehensiveness  of  the  list.  Reviewers  wanted  to  know  whether  or  not  the  list  would  support 
the  development  of  Attack  Aviation  exercises,  battle  drills,  and  tank  tactical  tables.  Following 
the  review,  the  project  SMEs  conducted  the  required  analyses  and  determined  that  the  list,  as 
designed,  would  support  the  construction  of  TSPs  for  the  exercise  types  in  question.  In  addition, 
minor  editorial  corrections  to  the  list  were  made  based  on  feedback  received. 

The  TSP  component  and  element  list  can  serve  as  the  basis  for  the  specification  and 
development  of  databases  required  to  support  TSP  development  within  the  ATIA.  Using  the 
components  and  elements  identified,  analysts  can  specify  data  types  and  relationships  such  that 
the  resulting  databases  will  serve  the  needs  of  TSP  users  involved  in  developing,  assessing,  and 
executing  the  collective  exercises  supported.  Furthermore,  the  databases  will  serve  as  the  basis 
for  the  applications  that  will  be  developed  within  the  ATIA  framework  to  support  the  various 


10  In  considering  the  live  fire  exercise,  it  was  questioned  whether  the  project  team  had  considered  the  gunnery 
exercise  as  a  type  of  training  supported  by  TSPs  for  collective  training.  Gunnery  had  not  been  a  focus.  Thus, 
project  SMEs  reviewed  the  list  for  components  that  might  be  required  for  gunnery  exercises,  but  that  were  not 
presently  included  in  the  list. 
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TSP  users.  The  next  section  of  the  report  addresses  how  those  TSPs  will  be  managed  and 
assessed  after  they  have  been  produced. 

User-Produced  TSP  Management  and  Assessment 

This  section  of  the  report  addresses  management  and  assessment  of  user-produced  TSPs.  It 
addresses  these  issues  in  the  context  of  the  Army’s  planned  top-level  training  information 
architecture  and  examines,  in  detail,  assessment  of  TSPs  from  the  viewpoint  of  various  users  and 
uses.  It  also  examines  management  issues  related  to  access  of  TSPs,  distribution  of  TSPs,  TSP 
approval,  and  TSP  maintenance. 

Assessment  of  User-Produced  TSPs 

When  a  user  produces  a  TSP,  either  by  creating  a  new  one  or  by  modifying  an  existing  one, 
several  levels  of  assessment11  may  be  needed  as  illustrated  in  Figure  12.  The  most  basic,  and 
probably  most  critical,  occurs  within  the  unit  (and/or  its  parent  organization)  and  involves 
assessing  whether  or  not  the  exercise  is  likely  to  be  effective  and  is  of  high  quality.  That  is, 
personnel  within  the  unit  examine  the  exercise  TSP  to  determine  whether  it  fits  the  unit’s 
training  needs  and  is  doctrinally  and  tactically  sound.  Specifically,  the  criteria  for  this 
assessment  are:  Does  the  exercise  match  the  unit’s  training  needs?  Is  the  exercise  tactically  and 
doctrinally  correct?  Are  the  Mission  Essential  Task  List  (METL)  tasks  and  supporting  collective 
and  individual  tasks  addressed  adequately?  Does  the  exercise  utilize  the  training  environment 
best  suited  to  the  unit’s  training  needs?  Are  the  resources  adequate  to  conduct  the  training?  Are 
safety  and  environmental  issues  addressed  adequately?  It  would  also  be  beneficial  to  assess  the 
TSP  in  terms  of  adherence  to  structured  training  principles;  however,  this  may  be  beyond  the 
level  of  expertise  of  unit  personnel  at  this  time.  As  structured  training  techniques  and  principles 
are  included  in  institutional  training,  unit  members  will  increasingly  be  able  to  assess  this  also. 
Unit  level  assessment  is  illustrated  by  the  bottom  step  in  Figure  12. 

Consistent  with  FM  25-100  doctrine  that  “leaders  in  the  chain  of  command  are  responsible 
for  the  training  and  performance  of  their  soldiers  and  units”  (DA,  1988,  p.  1-5),  this  level  of 
assessment  could  be  conducted  by  the  unit  commander  (e.g.,  the  platoon  leader  or  company 
commander  for  platoon-  or  company-level  exercises).  However,  to  ensure  that  the  training  fits 
within  the  larger  scope  of  higher  echelon  training  requirements,  the  exercise  should  also  be 
assessed  at  least  one  level  up  the  chain  of  command  (or  two  to  be  consistent  with  Army 
doctrine.)  This  is  especially  true  if  the  unit  commander  is  also  the  exercise  developer.  Platoon 
exercises  would  be  assessed  by  the  company  commander,  company  exercises  would  be  assessed 
by  the  battalion  commander,  and  so  on.  Also,  for  exercises  that  are  more  complex  (a  battalion- 
level  live  fire  exercise  for  example),  it  is  likely  that  this  assessment  would  be  conducted  by  a 
team  of  unit  personnel  such  as  the  battalion  and  brigade  commanders  and  operations  officers. 


11  When  we  talk  about  assessment  of  user-produced  TSPs,  we  are  talking  about  assessment  from  the  standpoint  of 
training  content,  training  methodology,  and  the  likelihood  that  the  exercise  will  be  successful.  We  are  not  talking 
about  TSP  components  or  fonnat.  We  assume  that  there  will  be  automated  tools  for  developing  exercise  TSPs, 
probably  as  a  component  of  SATS,  that  will  ensure  that  the  TSP  has  all  required  components  and  is  properly 
formatted  and  packaged  for  distribution  over  electronic  media. 
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Unit  assessment  results  in  a  decision  of  whether  the  exercise  is  “ready  to  be  run”  or  if  it  needs 
further  work.  Since  user-produced  TSPs,  unlike  those  produced  by  proponents,  are  not  likely  to 
go  through  a  developmental  testing  process,  this  assessment  is  extremely  important.12 
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Figure  12.  Training  support  package  assessment  levels. 

The  next  type  of  assessment  required  involves  examining  or  testing  the  exercise  from  a 
technical  or  logistic  standpoint  to  ensure  that  it  will  run  in  the  environment(s)  for  which  it  was 
developed.  This  is  shown  in  Figure  12  in  the  step  labeled  Site  Assessment.  For  example,  after 
developing  an  exercise  for  the  CCTT,  the  user  would  take  it  to  the  CCTT  site;  site  personnel 
would  assess  it  for  any  obvious  problems,  and,  if  possible,  would  “dry  run”  the  exercise  to 
ensure  that  it  can  be  executed.  (In  the  near  future,  desktop  systems  such  as  Modular  Semi- 
Automated  Forces  and  Both  Forces  will  provide  the  user  with  the  capability  to  complete  this 
assessment  without  the  need  to  involve  site  personnel.)  The  intent  of  this  assessment  is  to 
discover  execution  problems  related  to  the  simulation/simulator  or  site  prior  to  actually 
conducting  the  training  in  order  to  avoid  wasting  the  unit’s  training  time  and  resources. 


12  Based  on  input  from  interviews  the  team  conducted,  we  concluded  that  it  is  extremely  unlikely  that  any  collective 
exercise  will  be  run  more  than  once  without  some  type  of  modification.  Even  from  one  time  to  another,  the  same 
unit  will  have  slightly  different  training  requirements  necessitating  at  least  minor  changes  to  an  exercise  it  executed 
previously.  If  the  exercise  is  used  by  a  different  unit,  it  will  at  least  require  modifications  to  unit  names  and 
designations.  This  environment  does  not  efficiently  support  a  continuous  formative  evaluation  process. 
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The  next  type  of  assessment,  labeled  Execution  Assessment  in  Figure  12,  examines  how  the 
exercise  actually  worked  when  executed.  This  is  not  to  be  confused  with  assessing  the  unit’s 
performance  during  the  exercise.  Rather,  this  assessment  looks  at  such  things  as  whether  the 
events  in  the  exercise  occurred  as  planned,  whether  the  TSP  had  all  the  required  information,  and 
whether  the  cues  provided  were  adequate  to  produce  the  desired  unit  actions.  This  activity  is 
essentially  doing  formative  evaluation  of  the  exercise;  however,  since  the  exercise  is  likely  to  be 
executed  “as  is”  only  a  single  time  by  the  developing  unit,  it  is  not  likely  that  it  will  go  through 
an  iterative  development  process.  Instead,  the  information  obtained  during  exercise  execution  is 
added  to  the  TSP  in  the  “Exercise  Execution  Notes”  field  and  made  available  to  anyone  who  may 
consider  the  exercise  in  the  future  as  a  candidate  for  execution  or  modification. 

The  above  three  types  of  assessments  are  directed  primarily  to  providing  supporting  data  to 
the  initiating  unit’s  decision  regarding  whether  the  exercise  is  ready  to  be  run.  If  the  exercise 
stays  within  the  unit  or  is  never  considered  for  execution  again,  no  further  assessment  would  be 
necessary.  As  soon  as  one  begins  to  consider  distributing  exercises  to  other  users,  however, 
additional  assessment  is  required. 

Proponent  Assessment,  the  fourth  type  as  shown  in  Figure  12,  occurs  outside  the  initiating 
unit  and  will  typically  occur  for  exercises  that  are  going  to  be  made  available  to  other  units  via  a 
centralized  database  of  exercises.  This  assessment  is  directed  at  determining  whether  the 
exercise  is  of  sufficient  quality  and  meets  criteria  for  inclusion  in  the  database.  This  assessment 
involves  examining  the  exercise  for  doctrinal  correctness  and  proper  use  of  structured  training 
techniques  and  adherence  to  structured  training  principles.  It  also  addresses  issues  such  as:  Is 
this  exercise  substantially  the  same  as  one  already  in  the  database?  Does  the  exercise  include  all 
necessary  components?  Is  the  exercise  “packaged”  properly  for  distribution  via  electronic 
media?  The  identification  of  all  specific  criteria  that  apply  to  this  assessment  requires  further 
research  and  cannot  be  completed  until  decisions  are  made  regarding  technical  issues  related  to 
exactly  how  exercises  are  going  to  be  stored  and  shared,  including  how  they  are  going  to  be 
maintained. 

The  final  assessment  type  illustrated  in  Figure  12,  Selection  Assessment,  is  made  by  a  unit 
commander  considering  whether  or  not  to  use  an  exercise  obtained  from  another  unit  or  from  a 
centralized  database.  The  assessment  questions  asked  by  the  unit  “adopting”  the  exercise  would 
be  very  similar  to  those  discussed  above:  Does  the  exercise  match  the  unit’s  training  needs?  Are 
the  METL  tasks  and  supporting  collective  and  individual  tasks  addressed  adequately?  Does  the 
exercise  utilize  the  training  environment  best  suited  to  the  unit’s  training  needs?  Are  the 
resources  adequate  to  conduct  the  training?  Are  safety  and  environmental  issues  addressed 
adequately?  As  stated  previously,  it  is  extremely  unlikely  that  any  exercise  will  be  completely 
appropriate  for  execution  by  another  unit;  however,  it  may  be  usable  with  modifications. 
Therefore,  a  critical  assessment  issue  at  this  point  would  be  the  commander’s  estimate  of  the 
amount  of  modification  required  to  make  the  exercise  acceptable  for  use.  There  are  no  hard-and- 
fast  criteria  for  this  decision;  the  answer  will  depend  to  a  great  extent  on  the  previous  experience 
of  the  commander  in  creating  or  modifying  training  exercises. 

Taken  together,  these  five  types  of  assessments  of  the  TSP  may  appear  formidable. 

However,  the  first  three  are  essentially  what  is  being  done  currently  by  units  or  by  proponents 
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who  are  assessing  school-  or  contractor-produced  exercises.  The  remaining  two  only  come  into 
play  if  the  TSP  is  made  a  candidate  for  distribution. 

Access  to  User-Produced  TSPs 

Central  to  the  idea  of  user-produced  TSPs  is  the  notion  that  they  will  be  made  available  to 
other  units  with  similar  training  needs.  This  raises  the  question  of  how  other  units  will  be  able  to 
access  them.  For  purposes  of  exploring  this  question,  we  assume  that  units  developing  TSPs  will 
have  local  networks  and  that  their  network  servers  can  be  made  accessible  to  other  units.  We 
also  assume  that  there  will  be  centrally  located  servers  or  repositories  such  as  the  General  Dennis 
J.  Reimer  Training  and  Doctrine  Digital  Library  (RDL)  which  are  accessible  by  units.  We  can 
easily  eliminate  any  access  method  involving  a  direct  connection  to  a  unit  or  central  server. 

Direct  access  using  current  facilities  available  to  units  would  be  prohibitively  slow  and 
inefficient.  In  addition,  there  is  the  issue  of  how  users  would  know  where  to  look  for  a  given 
TSP.  Unless  all  TSPs  were  stored  in  a  central  repository,  some  methodology  or  procedure  would 
need  to  be  developed  for  informing  potential  users  of  all  available  TSPs  and  where  to  locate 
them.  This  is  quite  impractical.  Similarly,  we  can  eliminate  use  of  a  private  network  linking  all 
users  producing  or  searching  for  existing  TSPs  via  Army  or  Department  of  Defense  owned  or 
leased  facilities.  This  is  certainly  technologically  possible;  however,  the  cost  would  be 
prohibitive.  This  clearly  points  to  using  the  Internet. 

All  of  the  technology  necessary  to  access  and  share  user-produced  TSPs  via  the  Internet 
currently  exists  and  is  readily  available.  Internet  browsers  (e.g.,  Internet  Explorer  and  Netscape) 
are  universally  available,  and  development  of  a  custom  browser,  if  necessary,  is  not  difficult. 
Locating  TSPs  can  be  accomplished  with  existing  search  engines  (e.g.,  Yahoo,  Infoseek).  For 
ease  of  use,  the  browser  and  search  engine  could  be  incorporated  into  any  user  applications 
developed  to  create,  modify,  or  otherwise  use  TSPs. 

Of  more  concern  is  the  issue  of  security.  Individual  units  may  be  reluctant  to  give  access  to 
their  servers  to  non-unit  personnel  unless  a  high  level  of  security  can  be  guaranteed,  perhaps  by 
requiring  password  access  or  by  only  allowing  access  to  the  TSP  files  and  no  others.  Units  may 
be  more  comfortable  with  having  all  accessible  TSPs  located  on  a  central  server  such  as  the 
RDL.  This  would  provide  security  since  access  can  be  controlled  through  passwords,  but  could 
quickly  lead  to  storage  problems  on  the  RDL  as  more  and  more  exercise  TSPs  are  stored  there. 
We  also  question  the  efficiency  of  using  the  RDL  to  store  exercises  that  may  be  accessed  only 
rarely.  A  third  possibility  is  to  establish  a  network  of  servers  (at  proponent  schools,  for  example) 
that  could  be  used  for  TSP  storage  and  access.  This  does  not  eliminate  the  storage  issue  related 
to  a  central  server;  rather  it  mitigates  it  by  spreading  it  out  over  several  or  many  servers.  A 
fourth  alternative  is  to  develop  a  virtual  private  network  (VPN).  A  VPN  uses  encryption  to 
provide  secure  connections  over  the  Internet.  It  features  built-in  privacy  and  access  control  and 
allows  only  users  belonging  to  the  VPN  to  communicate  freely  across  it.  The  VPN  could 
provide  a  high  level  of  security  while  satisfying  the  ATIA  principle  that  data  be  logically 
centralized,  but  physically  dispersed. 

Each  of  these  alternatives  for  accessing  user-produced  TSPs  has  positives  and  negatives. 
While  the  project  team  leans  strongly  toward  an  alternative  that  uses  the  Internet,  further 
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research  taking  into  account  unit  needs,  Army-wide  requirements,  and  how  TSPs  are  distributed 
will  be  necessary  to  select  among  them. 

Distribution  of  User-Produced  TSPs 

There  are  myriad  ways  TSPs  could  be  distributed  depending  upon  how  one  looks  at 
questions  of  approval,  access  control,  and  maintenance.  Three  possibilities  are  illustrated  in 
Figure  13.  In  the  method  labeled  Centrally  Distributed,  all  user-accessible  TSPs  would  be  stored 
on  a  single  server  accessible  via  the  Internet.  As  will  be  explained  in  greater  detail  later,  this 
method  supports  approval  by  a  proponent  along  with  centralized  maintenance  of  the  TSPs 
themselves.  The  Widely  Distributed  method  provides  for  any  TSP  (that  the  developing  unit 
wishes  to  make  available)  being  accessible  to  any  user,  again  via  the  Internet.  This  method 
requires  no  central  approval  and  no  ongoing  maintenance.  The  third  alternative,  labeled  Hybrid 
Method,  combines  features  of  the  first  two.  In  this  method,  some  TSPs  will  be  accessible  from  a 
central  server;  others  will  be  accessible  directly  from  the  developing  unit’s  server.  The  TSPs  on 
the  central  server  could  be  the  core  set  identified  by  the  process  described  earlier.  In  addition,  if 
a  developing  unit  or  the  proponent  wished  to  nominate  an  exercise  for  inclusion  on  the  central 
server,  it  could  be  added  after  undergoing  a  proponent  assessment  and  approval  process.  The 
TSPs  accessible  directly  from  unit  servers  would  continue  to  require  no  external  approval  or 
maintenance.  Individuals  interviewed  were  evenly  split  between  the  Centrally  and  Widely 
Distributed  alternatives  with  the  primary  difference  lying  in  how  they  viewed  the  TSP  approval 
process.  Before  examining  the  differences,  however,  a  brief  discussion  of  common  issues  related 
to  TSP  distribution  is  in  order. 

Any  exercise  TSP  consists  of  a  large  amount  of  data  or  information  as  evidenced  in  the 
previous  discussion  of  TSP  components.  Many  of  these  components  appear  in  multiple  locations 
in  a  TSP.  In  addition,  the  organization  and  presentation  of  these  components  depends  largely 
upon  who  is  using  that  information.  These  factors  suggest  that  TSPs  are  best  treated  as  records 
or  files  and  that  database  applications  be  used  to  access  them.  This  eliminates  the  need  for  any 
user  to  enter  the  same  data  into  more  than  one  location  in  the  TSP,  as  he  or  she  would  need  to  do 
if  the  TSP  was  stored  and  maintained  as  a  word  processing  file.  It  also  allows  the  information  in 
the  TSP  to  be  formatted  and  presented  to  best  fit  the  needs  of  a  particular  TSP  user  by  providing 
a  “tool”  or  application  program  designed  specifically  for  that  user.  As  discussed  later,  the 
project  team  has  identified  six  unique  users  each  of  whom  will  use  different  components  of  the 
TSP  and  for  whom  these  components  might  be  presented  in  different  formats.  The  question 
becomes  how  best  to  make  TSPs  that  are  stored  as  database  records  or  files  sharable  among 
users. 

If  all  TSPs  are  stored  in  a  central  repository  (the  Centrally  Distributed  Method),  they  can 
simply  be  stored  as  records  in  a  single  database.  Users  would  access  individual  TSPs  by 
accessing  the  database  remotely,  viewing  the  available  records  and  selecting  the  specific  record 
they  wish  to  access.  That  record  could  be  transferred  to  the  user’s  local  machine  by  “packaging” 
the  record  as  a  unique  database  file  and  downloading  it,  all  of  which  would  be  transparent  to  the 
user.  The  user’s  application  would  treat  the  file  as  the  “back  end”  database  to  the  front  end 
application  he  or  she  was  using. 
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Figure  13.  Training  support  package  distribution  methods. 

If  all  TSPs  are  stored  in  a  central  repository  (the  Centrally  Distributed  Method),  they  can 
simply  be  stored  as  records  in  a  single  database.  Users  would  access  individual  TSPs  by 
accessing  the  database  remotely,  viewing  the  available  records  and  selecting  the  specific  record 
they  wish  to  access.  That  record  could  be  transferred  to  the  user’s  local  machine  by  “packaging” 
the  record  as  a  unique  database  file  and  downloading  it,  all  of  which  would  be  transparent  to  the 
user.  The  user’s  application  would  treat  the  file  as  the  “back  end”  database  to  the  front  end 
application  he  or  she  was  using. 

If,  on  the  other  hand,  TSPs  are  stored  on  and  accessed  from  any  unit’s  server  (assuming  the 
unit  chooses  to  make  it  available),  the  situation  is  somewhat  different.  The  TSP  still  needs  to  be 
a  database  file;  however,  it  must  be  searchable  using  either  an  existing  or  custom-made  search 
engine.  This  would  require  each  TSP  to  be  packaged  and  stored  as  a  separate  file,  and  to  have 
that  file  embedded  in  or  linked  to  an  Internet  browser-readable  file  (Hypertext  Markup  Language 
[HTML],  for  example).  These  alternatives  are  depicted  in  Figure  14.  In  the  Centrally 
Distributed  method,  users  search  only  the  TSP  database  using  an  application  which  displays  a 
“thumbnail”  description  of  each  exercise  matching  their  search  criteria.  When  they  find  the 
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exercise  they  want,  they  download  it  to  their  local  machines.13  In  the  Widely  Distributed 
method,  users  search  the  Internet  (or  a  VPN  on  the  Internet)  for  files  that  match  their  search 
criteria.  From  the  list  of  “links”  the  search  produces,  they  select  those  they  wish  to  examine  in 
more  depth  and  see  a  “thumbnail”  of  the  exercise.  When  they  find  the  one  they  want,  they  link 
to  the  actual  exercise  database  file  for  download  to  their  local  machine. 


Figure  14.  Training  support  package  access  and  retrieval  processes  for  Centrally  and  Widely 
Distributed  methods. 

To  support  the  Centrally  Distributed  method,  little  additional  information  or  data  will  be 
needed  in  the  TSP  itself.  The  user  links  to  the  remote  server  using  a  database  application  that 
can  access  the  remote  database  file  directly,  allowing  the  user  to  determine  whether  he  or  she 
wishes  to  download  the  exercise  or  not.14  To  support  the  Widely  Distributed  method,  on  the 


13  In  the  future,  technology  will  allow  the  user  to  work  with  a  file  on  the  remote  server  just  as  if  it  were  on  his  local 
machine.  However,  we  do  not  envision  this  being  the  case  in  the  next  five  years,  so  we  continue  to  propose 
downloading  of  the  TSP  file  to  the  user’s  local  machine. 

‘“While  the  technology  to  do  this  efficiently  may  not  be  readily  available  today,  we  anticipate  that  it  will  be  within 
the  five-year  scope  of  this  project.  At  present  the  application  to  access  and  download  the  TSP  would  most  likely 
reside  on  the  remote  server. 
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other  hand,  additional  information  or  material  needs  to  be  created  for  “packaging”  purposes: 
information  for  searching  for  the  exercise,  and  information  for  displaying  a  “thumbnail”  of  the 
exercise  to  the  user.  The  most  viable  methodology  for  accomplishing  the  “packaging”  is  to 
create  an  Internet  browser-readable  file  (e.g.,  an  HTML  file)  as  shown  in  Figure  15.  The  user 
application,  either  automatically  or  at  the  direction  of  the  user,  would  create  the  HTML  file  from 
existing  data  in  the  exercise  TSP.  The  file  would  contain  the  information  to  facilitate  a  search 
and  the  information  that  makes  up  the  thumbnail.  It  would  also  contain  a  link  to  the  actual 
exercise  TSP  file.  The  project  team  has  included  the  “key  word  index”  data  element  in  the  TSP 
components  list  to  serve  the  first  function;  the  second  would  be  served  by  pulling  together  other 
data  elements  that  are  sufficient  to  provide  a  detailed  enough  description  of  the  exercise  to  allow 
the  user  to  select  it.15  The  Hybrid  Distribution  method  would  combine  both  of  these  access  and 
retrieval  methods. 
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Figure  15.  The  TSP  packaging  process. 


15  To  eliminate  different  access  and  retrieval  methods,  it  is  quite  possible  to  use  the  HTML  method  even  for  TSPs 
stored  on  a  central  database.  Each  TSP  would  be  treated  as  a  separate  file.  This  may  warrant  further  research. 
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The  distribution  methods  described  conform  to  ATIA  principles:  They  separate  the  data 
from  the  applications  used  to  access  them,  any  metafiles  created  are  user-oriented,  and  data  are 
logically  centralized  while  physically  distributed.  As  with  access  issues,  further  study  will  be 
needed  to  make  final  decisions  regarding  distribution  methods;  however,  at  this  time,  the  project 
team  strongly  advocates  use  of  the  Hybrid  method.  It  utilizes  the  best  features  of  both  the 
Centrally  and  Widely  Distributed  methods:  It  makes  TSPs  that  are  part  of  a  core  set  easy  to 
locate  and  access  while  not  overburdening  the  central  server  housing  these  TSPs,  and  it  allows 
access  to  every  TSP  that  has  been  made  available  regardless  of  how  obscure  it  may  be. 

User-Produced  TSP  Approval 

Based  on  the  responses  of  the  personnel  interviewed,  TSP  approval  is  likely  to  be  a 
contentious  issue.  At  one  end  of  the  spectrum,  there  were  those  who  felt  strongly  that  no  TSP 
should  be  made  available  that  had  not  gone  through  a  proponent  assessment  and  been  approved 
for  distribution.  The  major  concern  was  that  poor  quality  exercises  would  proliferate  and 
collective  training  would  eventually  be  severely  degraded.  On  the  other  end  of  the  spectrum 
were  those  who  thought  that  all  TSPs  should  be  made  available  to  any  user,  and  that  the  user  is  in 
the  best  position  to  assess  the  TSP  and  determine  whether  or  not  it  fits  his  or  her  needs. 

The  project  team  agrees  that  the  unit  commander  is  the  final  authority  on  the  training  needs 
of  his  or  her  unit.  However,  he  or  she  is  probably  not  the  most  qualified  person  forjudging  the 
appropriateness  or  quality  of  a  TSP  for  use  outside  his  or  her  unit.  At  this  time  and  for  the 
foreseeable  future,  there  is  a  need  for  proponent  approval,  at  least  for  those  exercises  that  are 
stored  in  a  central  repository.  The  TSP  users  will  have  a  tendency  to  view  exercises  that  are 
stored  in  a  central  repository  as  having  been  “blessed;”  therefore,  positive  steps  need  to  be  taken 
to  ensure  they  are  of  highest  quality.  In  addition,  any  exercises  added  to  the  central  repository 
will  need  to  go  through  the  same  proponent  approval  process.  Users  will  perceive  them  as 
exemplars.  Those  TSPs  which  are  not  placed  in  a  central  repository,  on  the  other  hand,  do  not 
need  to  undergo  proponent  approval.  The  unit  commander  who  considers  the  TSP  for  possible 
execution  or  modification  is  quite  capable  of  determining  whether  the  exercise  is  doctrinally 
sound  and  if  it  serves  his  training  needs. 

User-Produced  TSP  Maintenance 

Maintenance  of  user-produced  TSPs  basically  involves  making  sure  that  they  are  kept 
current.  Do  they  conform  to  current  MTPs  and  other  Army  manuals,  and  are  they  still 
compatible  with  the  TADSS  needed  to  execute  them?  However,  before  considering  how  this 
would  be  accomplished,  we  need  to  look  at  whether  it  should  be  accomplished.  The  answer,  as 
with  TSP  approval,  depends  on  how  the  TSP  is  distributed.  The  TSPs  stored  in  a  central 
repository  are  likely  to  be  considered  differently  by  users  from  those  they  find  on  unit  servers. 
First,  users  will  associate  the  centrally  stored  TSPs  with  the  proponent,  and  it  is  reasonable  to 
assume  that  they  will  think  of  them  as  approved  and  current.  On  the  other  hand,  they  are  likely 
to  consider  TSPs  found  on  a  unit  server  as  ones  that  were  developed  for  a  particular  training 
need,  were  run  once,  and  have  not  been  looked  at  since,  thus  requiring  closer  scrutiny.  Based  on 
this  approach,  we  conclude  that  the  centrally  stored  TSPs  will  require  ongoing  maintenance;  the 
others  will  not. 


33 


Maintenance  of  centrally  stored  TSPs  is  likely  to  involve  substantial  effort.  Whenever 
manuals  change,  or  there  is  a  change  in  the  TADSS,  each  exercise  that  uses  that  manual  or 
TADSS  will  need  to  be  examined  to  determine  the  impact  of  the  changes.  Based  on  this 
examination,  the  exercise  may  need  to  be  revised.  It  is  possible  some  revisions  could  be 
automated;  however,  this  will  likely  work  only  with  the  simplest  of  revisions.  The  burden  of 
TSP  maintenance  will  probably  rest  with  the  proponents  and  it  must  be  recognized  that 
substantial  effort  will  be  involved. 

Maintenance  of  TSPs  kept  on  the  unit  servers  would  neither  be  required  nor  cost-effective. 
First  of  all,  there  is  the  question  of  who  would  do  it.  With  everything  else  that  demands 
commanders’  attention,  it  is  very  unlikely  that  they  are  going  to  be  concerned  with  exercises 
developed  or  executed  in  the  past.  This  is  particularly  true  if  they  are  never  likely  to  run  that 
exercise  again.  What  is  realistic  to  expect  is  that  “maintenance”  will  occur  whenever  another 
unit  selects  that  exercise  for  its  own  use.  That  is,  one  of  the  considerations  unit  commanders  will 
make  when  they  select  an  exercise  is  whether  it  uses  current  Field  Manuals  (FMs),  MTPs,  and 
TADSS.  In  fact,  it  would  be  even  more  efficient  if  the  user  tool  or  application  they  are  using 
could  transparently  compare  the  MTP  tasks  and  TADSS  to  the  current  versions  and  report  any 
discrepancies  to  them.  This  would  allow  them  to  make  a  better  informed  decision  to  use  the 
exercise  or  not.  In  any  case,  making  the  TSP  conform  to  the  latest  manuals  will  be  necessary 
only  if  the  commander  decides  to  use  the  exercise. 

User  Tools 

A  user  tool  or  tool  set  needs  to  provide  the  functionality  required  to  produce,  administer, 
execute,  and  assess  collective  training  exercises  and  their  supporting  TSPs.  Given  that  a  TSP  is 
most  efficiently  treated  as  a  database,  any  user  tool  developed  should  be  a  database  application 
which  provides  access  to  the  database  of  TSPs  regardless  of  how  they  are  distributed.  The  tool 
or  tools  should  also  provide  built-in  guidance  and  performance  aids  and  access  to  other 
databases,  such  as  those  on  the  RDL,  that  may  be  needed  to  accomplish  these  functions. 

There  are  a  number  of  issues  or  variables  to  consider  when  attempting  to  identify  potential 
tools  for  the  various  TSP  users.  First  is  the  identification  of  the  users  themselves  and  the  role 
each  will  play  in  exercise  development  and  execution.  Another  issue  concerns  whether  it  would 
be  more  efficient  to  have  one  tool  that  serves  the  needs  of  all  users  or  separate  tools  tailored  to 
individual  user  needs.  A  related  issue  concerns  whether  the  same  tool  or  tools  will  work  for 
exercises  developed  for  various  exercise  types  and  various  training  environments. 

Additionally,  the  identification  of  user  tools  needs  to  consider  the  larger  context  of  the 
ATIA  since  any  tools  identified  and  developed  would  become  components  of  it.  More 
specifically,  we  need  to  attend  to  the  ATIA  principles  and  guidelines  that  the  application  tools 
are  segregated  from  the  data  they  use,  that  the  data  are  logically  centralized  but  physically 
dispersed,  and  that  there  will  be  one-time  data  entry  to  update  all  related  system  databases.  Any 
tool  developed  needs  to  satisfy  these  requirements. 
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TSP  Users  and  Application  Requirements 

The  project  team  examined  the  various  roles  that  occur  in  the  development  and  execution  of 
collective  exercises  in  the  live,  virtual,  and  constructive  environments  and  identified  six  user 
groups:  TSP  developers;  exercise  O/Cs;  exercise  support  personnel  including  opposing  forces 
(OPFOR);  site  staff;  unit  administrative  support  personnel;  and  the  training  unit  itself.  Each  of 
these  groups  has  unique  needs  for  the  various  TSP  components  discussed  earlier,  and  each  has 
different  roles  to  play  in  the  development  and  execution  of  collective  exercises.  They  all  need 
access  to  the  same  database  of  TSPs  regardless  of  whether  they  are  using  separate  tools  or 
different  components  of  one  large  master  tool.  The  individual  tools  or  components  of  a  master 
tool  should  be  structured  so  that  only  the  information  required  by  the  user  is  made  available  to 
him  or  her,  and  for  those  users  who  need  only  review  the  TSP  content,  their  access  should  be 
limited  to  read-only.  The  users  and  their  roles  are: 

1 .  Exercise  developer  -  develops  the  exercise,  either  by  creating  a  new  one  or  by  modifying 
an  existing  one.  This  individual,  or  in  some  cases  group  of  individuals,  will  initially 
provide  the  vast  majority  of  data  for  the  TSP.  The  developer  tool  or  function  needs  to  be 
structured  around  a  sound  training  development  process  for  the  exercise  type  and 
environment  selected  and  needs  to  have  access  to  all  components  and  elements  of  the 
TSP. 

2.  Exercise  O/Cs  -  responsible  for  observing  performance  of  the  training  unit;  facilitating 
exercise  after  action  reviews  (AARs);  coordinating  the  events  that  occur  in  the  exercise; 
participating  in  exercise  planning  and  preparation;  and  producing  take  home  packages  if 
appropriate.  The  O/C  tool  or  function  needs  to  allow  access  to  all  of  the  developer- 
produced  information  for  review  purposes.  It  also  needs  to  allow  the  O/C  to  add  new 
data  or  modify  existing  data  for  exercise  scheduling,  as  well  as  for  creating  observation 
materials,  AAR  materials,  and  take  home  packages. 

3.  Exercise  support  personnel  -  participate  in  exercise  execution  by  supporting  the  activities 
of  the  training  unit  or  by  playing  the  role  of  the  OPFOR.  Support  personnel  may  be 
military  personnel  from  the  training  or  other  unit  or  site  or  training  area  staff.  Individuals 
participating  in  the  exercise  in  support  capacities  need  to  be  able  to  review  the  TSP 
information  required  to  perform  their  role;  they  will  not  need  to  modify  or  create  any  new 
information.  The  exercise  support  position  tool  needs  to  allow  access  to  the  information 
each  individual  needs  to  complete  his  activities  in  the  exercise,  which  suggests  that  the 
tool  or  function  will  be  able  to  filter  the  TSP  based  on  the  particular  support  role  being 
played.  As  training  environments  and  TADSS  evolve  to  use  the  same  workstation  to  play 
multiple  support  roles,  at  least  in  virtual  and  constructive  environments,  the  exercise 
support  position  tool  may  need  to  change  also. 

4.  Site  staff-  the  personnel  at  the  training  site  or  training  area  who  are  responsible  for 
coordinating  and  scheduling  training,  ensuring  that  the  exercise  can  be  executed  at  the 
site  or  area,  and  providing  the  persons  and  equipment  necessary  to  execute  the  exercise. 
The  site  staff  tool  or  function  needs  to  allow  access  to  the  TSP  information  needed  to 
support  exercise  execution.  It  could  also  provide  appropriate  scheduling  and  reporting 
support,  although  those  would  not  become  part  of  the  TSP.  Finally,  it  would  provide 
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input  access  to  the  Exercise  Execution  Notes  component  of  the  TSP  for  entry  of 
information  that  would  assist  unit  and  site  personnel  in  executing  the  exercise  in  the 
future. 

5.  Unit  administrative  support  personnel  -  individuals  from  the  training  unit  or  a  higher 
echelon  unit  who  are  responsible  for  completing  the  scheduling  and  coordination 
necessary  to  run  the  training  exercise.  These  individuals  will  most  likely  come  from  the 
operations  section  of  the  unit  and  will  coordinate  with  the  training  unit,  the  personnel 
who  will  observe/control  the  exercise,  the  exercise  support  personnel,  the  site 
administrative  and  support  personnel,  and  anyone  else  required  to  successfully  run  the 
exercise.  The  administrative  support  tool  or  function  needs  to  allow  access  to  all  of  the 
TSP  information  since  all  of  it  may  impact  exercise  coordination.  It  might  also  include 
scheduling  and  coordination  support  tools,  although  that  information  would  not  become 
part  of  the  TSP. 

6.  Training  unit  -  the  personnel  being  trained  through  execution  of  the  exercise.  The 
training  unit  needs  access  to  the  components  of  the  TSP  necessary  to  provide 
background,  motive,  and  enough  information  to  conduct  preliminary  training  and 
rehearsal  for  the  actions  they  will  take  during  exercise  execution.  In  the  case  of  live 
training,  the  unit  needs  access  to  sufficient  information  to  conduct  pre-combat 
inspections,  move  to  the  training  area,  and  plan  for  exercise  logistic  support.  For 
example,  depending  on  the  specific  exercise  being  executed,  they  might  need  access  to 
training  tasks  and  objectives,  the  Road  to  War  information,  operations  orders  (OPORDs), 
maps  and  overlays. 

An  Example  User  Application 

To  illustrate  further  the  nature  of  the  user  tools  being  considered,  the  project  team  developed 
screen  shots  that  represent  how  one  specific  tool  or  function  might  operate.16  The  tool  selected 
was  the  O/C  tool,  the  functionality  of  which  is  illustrated  in  Figure  16.  The  O/C  tool  allows 
users  who  will  be  observing/controlling  an  exercise  to  locate  the  appropriate  exercise  TSP  either 
from  a  central  repository  or  from  a  widely  distributed  source.  Once  located,  they  can  then 
review  all  of  the  information  needed  to  complete  the  exercise  O/C  activities  including  the 
exercise  materials  themselves  and  the  previous  training  history  of  the  unit.  They  can  complete 
any  necessary  scheduling  activities  including  coordination  with  other  personnel  who  will 
observe/control  the  exercise  and  any  pre-execution  meetings.  They  can  produce  observation 
materials  to  be  used  during  exercise  execution  as  well  as  materials  for  conducting  AARs. 

Finally,  they  can  produce  take-home  packages,  if  appropriate.  Integral  to  the  application  would 
be  “help”  and  other  information  to  assist  the  user  in  completing  the  O/C  tasks  or  in  using  the 
application  itself.  A  relatively  complete  set  of  screen  shots  for  the  O/C  application  is  available 
from  ARI  at  Fort  Knox.  Similar  applications  could  be  developed  for  the  other  users  identified. 


16  We  should  point  out  that  one  tool,  CITT,  has  already  been  developed  for  exercises  conducted  using  CCTT.  That 
tool  currently  includes  some  degree  of  functionality  for  each  of  the  user  groups. 
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Take  Home  Packages 

- - — — -  . - — ;  Tool  Main  Screen 


:j,.:  Welcom*  to  th«  Ob«erv*r/C£>ntroll«r  Too)  the 
^Army's  premier  on-line  resource  lor  training 

I  technology  data  and  information. 

The  ObserverConl  rolle  r  tool  I*  designed  to 
provide  you  the  widest  possible  range  of 
Information  resources  to  assist  In  the 
planning,  preparation,  execution,  and 
assessment  of  training  exercises. 


Review  Exercises 


After  Action  Review 


Control  Exercises 


Schedule  Training 


•  ■  •.  /**~'-**  ■  a  £  J  i 


Plan  for  Training 


Figure  16.  Example  functionality  for  the  observer/controller  application. 

Additional  User  Application  Issues 

Applications  Segregated  from  Databases.  The  ATIA  specifies  that  applications  developed 
within  it  be  segregated  from  the  database(s)  which  support  them.  By  linking  the  application  to 
the  database  rather  than  embedding  the  database  in  the  application,  a  number  of  benefits  are 
achieved.  First,  multiple  applications  can  link  to  the  same  database  with  each  application  being 
designed  around  only  those  functions  which  are  integral  to  it.  So,  for  example,  an  application  for 
exercise  support  personnel  will  link  to  the  TSP  database  (whether  centrally  or  widely  distributed) 
and  will  provide  users  with  access  to  those  elements  of  the  TSP  needed  to  complete  their  role  in 
the  exercise.  Similarly,  the  training  unit  will  be  able  to  access  the  TSP  but  only  to  review  or 
obtain  the  elements  needed  to  set  up  their  training  -  OPORDs  and  overlays,  for  example.  All 
other  information,  such  as  where  the  OPFOR  will  appear  and  how  they  will  fight,  would  be 
unavailable  to  them.  In  fact,  for  these  users,  access  to  the  TSP  could  be  “read  only”  since  they 
need  only  obtain  information  and  have  no  reason  for  modifying  the  TSP.  More  detailed  research 
will  be  required  to  determine  precisely  what  functions  each  user  application  will  include  and  how 
access  to  the  TSP  will  be  provided. 
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On  the  other  hand,  for  those  users  who  do  have  a  legitimate  reason  for  modifying  the  TSP, 
segregating  the  application  from  the  database  supports  the  principle  that  there  be  one-time  data 
entry  for  all  uses  and  all  users  of  the  TSP.  If  training  site  personnel  need  to  modify  the  exercise 
TSP  to  ensure  that  it  actually  works  at  the  site,  for  example,  any  changes  they  make  will  flow  to 
all  users  of  the  TSP.  Also,  if  the  modification  appears  in  multiple  locations  in  the  TSP  for  any 
user,  it  will  need  to  be  entered  only  once. 

Implied  in  this  discussion  is  the  requirement  that  a  mechanism  be  developed  for  ensuring 
that  a  single  version  of  the  TSP  be  maintained.  This  is  relatively  simple  if  the  TSPs  are 
contained  in  a  centrally  maintained  database  -  it  is  a  matter  of  controlling  “write”  access 
privileges.  For  widely  distributed  access,  on  the  other  hand,  the  situation  is  considerably  more 
complicated.  If  a  TSP  is  obtained  from  a  unit  server  by  a  user  who  has  legitimate  reason  to  add 
to  or  modify  it,  that  user  needs  a  way  to  update  the  TSP  on  the  unit’s  server.  Procedures  for 
providing  this  type  of  access  will  need  to  be  developed.  If  the  user  only  modifies  the  TSP  on  his 
or  her  local  computer,  it  will  not  migrate  to  the  version  on  the  unit’s  server,  and,  very  quickly, 
multiple  versions  of  the  same  TSP  will  exist  making  the  whole  process  of  exercise  development 
and  execution  extremely  difficult.  In  the  future,  this  difficulty  will  be  mitigated  to  some  extent 
by  the  likelihood  that  technology  for  remotely  accessing  and  modifying  files  will  develop  to  the 
point  that  it  will  be  eminently  possible  for  a  user  in  one  location  to  modify  a  TSP  stored  on  a 
computer  in  another  location  as  easily  as  if  it  were  on  his  local  machine. 

Different  Applications  for  Different  Environments.  An  issue  that  was  not  addressed  by  the 
current  project  concerns  whether  or  not  the  same  user  application  will  work  effectively  for 
training  in  live,  virtual,  constructive,  or  combined  environments.  Will  the  same  basic  TSP 
development  tool  work  equally  well  for  developing  an  exercise  for  CCTT  as  for  Warfighter 
Simulation?  Similarly,  will  the  same  tool  work  equally  well  for  developing  a  relatively 
constrained  exercise  such  as  one  for  CCTT  versus  a  much  larger  exercise  such  as  that  used  in  a 
Synthetic  Theater  of  War  environment?  The  critical  question  is  not  one  of  size  of  the  exercise  as 
much  as  complexity.  Will  the  same  tool  serve  the  needs  of  all  exercise  development  or  will 
variations  be  needed?  Further  research  is  needed  to  address  these  questions. 

Multiple  Applications.  Finally,  there  is  the  question  of  whether  there  is  a  single  integrated 
application  that  includes  the  functionality  required  for  all  users,  or  whether  it  is  more  efficient  to 
develop  multiple  applications.  We  favor  the  latter  alternative.  First,  it  greatly  simplifies  the 
individual  applications  if  they  need  serve  only  one  type  of  user.  And,  since  each  application  is 
linking  to  the  same  database,  there  is  no  problem  with  different  applications  using  different  data. 
In  addition,  it  allows  for  the  possibility  that  different  applications  fit  within  different  functions  of 
the  ATIA.  It  is  fairly  clear,  for  example,  that  the  TSP  development  application  fits  within  the 
Unit  Training  Management  System  or  SATS  component  of  ATIA.  It  is  less  clear  where  other 
user  applications  best  fit. 
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Summary  and  Conclusions 


This  report  has  presented  the  results  of  a  research  project  to  examine  issues  related  to 
assessing  and  managing  user-produced  TSPs,  where  “user-produced”  refers  to  TSPs  that  are 
developed  by  unit  commanders  and  other  unit  trainers  as  well  as  institutional  trainers  who  will  be 
directly  involved  with  executing  the  exercises  they  produce.  In  addition,  the  SOW  (ARI,  1999) 
focused  the  research  on  combat  arms  organizations  at  brigade  and  below  and  directed  the  project 
team  to  address  collective  training  in  live,  virtual,  constructive,  and  combined  environments  at 
present  and  for  the  next  five  years. 

The  major  research  activities  consisted  of:  data  collection  from  a  wide  variety  of  sources 
including  existing  reports  and  other  documentation,  Internet  sites,  and  knowledgeable 
individuals;  data  analysis  completed  individually  and  as  a  group;  and  development  of  products  to 
fulfill  the  project  objectives  based  on  the  analyses  of  the  data  collected.  A  major  focus  of  data 
collection  was  coordinating  with  the  ongoing  development  of  the  ATIA  which  will  establish  a 
framework  within  which  the  products  of  the  current  project  fit.  In  achieving  the  project 
objectives,  several  outcomes  or  products  were  produced. 

We  developed  a  process  for  identifying  core  set  exercises  for  combat  arms  units.  This  five- 
step  process  involves  identification  of  the  unit  for  which  the  core  set  is  being  specified, 
determining  viable  training  methods  in  terms  of  exercise  types  and  training  environments  for  the 
unit,  specifying  the  content  of  the  core  set  in  terms  of  the  collective  tasks  upon  which  it  focuses, 
and  identifying  the  specific  exercises  that  comprise  the  core  set.  Using  this  process,  proponents 
will  be  able  to  identify  the  exercises  that  could  be  included  in  a  library  or  repository  of  exercises 
that  would  serve  the  majority  of  the  collective  training  needs  for  a  unit. 

We  identified  the  components  and  elements  of  a  TSP  for  collective  training  exercises  to  a 
level  sufficient  to  develop  database  specifications  for  them.  Although  we  did  not  develop 
database  specifications,  the  work  completed  here  will  greatly  facilitate  such  development  which 
is  an  important  step  in  the  further  development  of  the  ATIA.  As  part  of  this  activity,  we  also 
came  to  the  conclusion  that  the  same  TSP  components  and  elements  can  serve  all  collective 
training  exercises  for  live,  virtual,  and  constructive  environments. 

We  examined  how  user-produced  TSPs  should  be  assessed  and  identified  five  levels  of 
assessment  that  may  be  required  depending  upon  how  the  TSP  is  distributed.  We  also  examined 
management  issues  including  how  users  will  access  TSPs,  how  TSPs  might  be  distributed,  and 
the  approval  and  maintenance  processes  for  distributed  TSPs. 

Finally,  consistent  with  the  user  configurations  identified  in  the  ATIA,  we  identified  six 
types  of  users  for  TSPs  including  developers,  exercise  support  personnel,  O/Cs,  site  personnel, 
unit  administrative  support  personnel,  and  the  unit  itself.  We  examined  the  requirements  each  of 
these  user  types  will  have  for  the  information  contained  in  the  TSP  and  considered  the  type  of 
user  tool  or  application  that  would  serve  these  needs.  We  also  examined  one  such  tool  -  that  for 
the  O/C  -  in  some  detail  and  produced  prototype  screens  showing  how  it  would  function. 
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Based  upon  the  research  completed,  the  project  team  came  to  the  following  conclusions: 

1 .  It  is  possible  to  specify  a  systematic  process  for  identifying  the  exercises  that  would 
comprise  a  core  set  of  exercises  for  a  given  combat  arms  unit.  This  process  can  be  used 
by  various  proponents  to  determine  the  exercises  that  would  comprise  a  repository  of 
exercises  that  would  serve  many  of  the  collective  training  needs  of  units.  As  users 
develop  more  exercises  themselves,  it  will  become  increasingly  important  to  have  core 
sets  available  that  provide  exemplary  exercises  for  use  as  is  or  that  can  be  modified  to 
serve  the  user’s  specific  training  needs. 

2.  The  same  set  of  TSP  components  and  elements,  and  thus  the  same  TSP  database 
structure,  can  be  used  for  all  collective  training  exercises  for  combat  arms  units  at  brigade 
and  below  in  live,  virtual,  constructive,  and  combined  environments.  The  vast  majority 
of  components  and  elements  are  common  to  all  exercises,  and  the  small  subset  that  are 
not  can  be  handled  easily  by  the  user  tools  that  will  be  developed  to  produce  and  present 
exercise  TSPs.  Individuals  currently  developing  databases  to  support  collective  exercise 
TSPs  within  the  ATIA  can  use  the  component  and  element  list  produced  in  this  project  as 
a  starting  point  for  their  efforts. 

3.  There  are  several  ways  that  user-produced  TSPs  could  be  distributed  to  other  potential 
users;  however,  the  hybrid  method  that  combines  both  the  central  distribution  of  core  set 
TSPs  and  distribution  from  unit  servers  of  all  others  appears  to  offer  the  greatest  utility. 
This  method  makes  the  greatest  number  of  TSPs  available  to  the  greatest  number  of 
users.  Further  research  into  the  infrastructure  required  to  support  hybrid  distribution  is 
needed  to  determine  the  feasibility  of  using  existing  technology,  such  as  the  Internet,  as 
well  as  the  physical  facilities  currently  available  at  typical  Army  installations. 

4.  A  TSP  assessment  methodology  is  critical  to  the  whole  concept  of  sharing  TSPs  among 
units  since  it  provides  some  level  of  assurance  that  quality  standards  have  been  met.  The 
present  project  proposes  multiple  types  or  levels  of  assessment  of  user-produced  TSPs 
depending  upon  the  purpose  of  the  assessment  and  how  TSPs  will  be  distributed.  All 
user-produced  TSPs  require  assessment  within  the  developing  unit,  however,  only  those 
distributed  from  a  centralized  repository  require  proponent  assessment  and  approval.  The 
TSPs  distributed  from  unit  servers  will  be  assessed  by  the  units  considering  them  for  their 
own  use. 

5.  There  are  multiple  users  of  TSPs  each  of  whom  has  different  needs  and  requirements. 
These  users  will  be  best  served  by  having  a  tool  available  that  specifically  addresses  their 
needs.  These  tools  should  be  database  applications  and  may  be  stand-alone  or  may  be  a 
“plug  in”  to  one  of  the  functions  specified  in  the  ATIA.  All  tools  would  access  the  same 
database(s)  of  TSP  components  and  elements. 

This  project  has  examined  issues  related  to  user-produced  TSPs  in  depth.  In  so  doing,  we 
have  concluded  that,  although  not  specifically  addressed  in  the  ATIA,  user-produced  TSPs  and 
the  ATIA  are  fully  compatible.  Future  efforts  to  develop  ATIA  and  corresponding  training 
information  systems  can  build  upon  the  work  completed  here  to  make  full  use  of  the  unit-based 
training  resources  that  exist  throughout  the  Army. 
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Appendix  A 
Acronym  List 


AAR 

after  action  review 

AFRU 

Armored  Forces  Research  Unit 

AirNet 

Air  NETwork 

ARI 

U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 

ATIA 

Army  Training  Information  Architecture 

ATR 

Administrative  Training  Rules 

CATS 

Combined  Arms  Training  Strategy 

CCTT 

Close  Combat  Tactical  Trainer 

CFX 

command  field  exercise 

CITT 

Commanders’  Integrated  Training  Tool 

COR 

contracting  officer’s  representative 

CPX 

command  post  exercise 

DA 

Department  of  the  Army 

DCSPER 

Deputy  Chief  of  Staff  for  Personnel 

DCST 

Deputy  Chief  of  Staff  for  Training 

FCX 

fire  control  exercise 

FM 

Field  Manual 

FTX 

field  training  exercise 

HTML 

Hypertext  Markup  Language 

HumRRO 

Human  Resources  Research  Organization 

LCX 

Logistical  Coordination  Exercise 

LFX 

live  fire  exercise 

MAPEX 

Map  Exercise 

METL 

Mission  Essential  Task  List 

MFR 

Memorandum  for  Record 

MTP 

Mission  Training  Plan 

NBC 

nuclear,  biological,  and  chemical 

NCO 

Non-commissioned  Officer 

O/C 

observer/controller 

OPFOR 

opposing  forces 

OPORD 

operations  order 

RDL 

General  Dennis  J.  Reimer  Training  and  Doctrine  Digital  Library 

A-l 


SAT 

Systems  Approach  to  Training 

SATS 

Standard  Army  Training  System 

SIMNET 

Simulation  Networking 

SME 

subject  matter  expert 

SOW 

statement  of  work 

STX 

Situational  Training  Exercise 

TADSS 

training  aids,  devices,  simulators,  and  simulations 

TC 

Training  Circular 

TD 

training  development 

TDA 

table  of  distribution  and  allowances 

TEWT 

Tactical  Exercise  Without  Troops 

TOE 

table  of  organization  and  equipment 

TR 

TRADOC  Regulation 

TRADOC 

U.S.  Army  Training  and  Doctrine  Command 

TRADOC  ODCST 

TRADOC  Office  of  the  Deputy  Chief  of  Staff  for  Training 

TSP 

training  support  package 

VPN 

virtual  private  network 
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Appendix  C 

TSP  Components  from  TR  350-70 


Section  I.  Overview  Tab 

TSP  Cover  Page 

TSP  Preface  Page 

Event  Task  Summary 

Table  of  Contents 

Definition/  Obj  ective/Environment 

Training  Area  Requirements 

CATS  Gates 

History/NBC 

SATS  Event  Detail 

SATS  Coordination  Detail 

Section  II.  Scenario  Tab 

General  Information: 

-  Scenario  Materials 

-  Target  Audience 

-  Training  Sequence  and  Duration 

-  Collective  Task  TEOs/Individual  Task  Summaries 

-  Participating  Units 

-  Army  Aviation/Casualty  Assessment 

Administrative  Training  Rules  (ATR): 

-  Intro/Special  Instructions 

-  Direct  Fire  Engagement 

-  AD  and  TACAIR/CEW 

-  Dismounted  Infantry  Engineers 

-  Fire  Support 

-  NBC/CSS 

-  POW/Safety 

-  Risk  Identification  Assessment  Worksheet 

-  Risk  Mitigation  Worksheet 

-  Risk  Leader  Approval 

-  Army  Aviation/Casualty  Assessment 

Equipment/Personnel  Requirements: 

-  Unit  MTOE  Equipment  Requirements 

-  Unit  Ammo  Requirements 

-  Unit  PLL 

-  Unit  Support  Elements  Equipment 

-  Support  Personnel 
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Environmental 

-  Environmental  Conditions 

Evaluator  Support  Materials: 

-  O/C  Personnel 

-  Qualifications/Location/Requirements 

-  O/C  Preparation 

-  O/C  Evaluation  Objectives 

-  O/C  Additional  Information 

-  O/C  Equipment/Facility  Requirements 

-  Contingency  Workarounds 

-  After-Action  Review/After  Exercise  Report 

-  Take  Home  Package  Construction  Guide 

-  Semi- Automated  Forces 

Operations  Order  OPORD: 

-  Situation/Mission 

-  Execution 

-  Service  Support 

-  Command  and  Signal 

-  Create/Edit  OPORD  Annex  Titles 

-  OPORD  Execution  Matrix 

Maps  and  Overlays: 

-  Maps  and  Overlays 

Section  III.  Preparation  Tab 

Leader's  Training  Guide 
Demonstration 
Alternate  TADSS 
Systems  to  be  used 

Section  IV.  Simulation  Tab 

Section  V.  Environmental  Tab 

Section  VI.  Resourcing  Tab 

SATS  Resourcing  BLUFOR 
BLUFOR  logistics  Support  Requirements 
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Section  VII.  OPFOR  Tab 


Package  Overview/Orders 

ROE/Tasks 

Initialization  Data 

Environmental  Conditions 

OPFOR  Execution  Matrix 

SATS  OPFOR  Resourcing  Report 

OPFOR  Logistics  Support  Requirements 

Section  VIII.  Reference  Tab 
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Appendix  D 

TSP  Components  from  TC  25-10 


Introduction 

Table  of  Contents 

List  of  Collective  Tasks  Trained 

List  of  Supporting  Individual  Tasks 

General  &  Special  Situations  (Scenario) 

OPORDs 
Lane  Diagram 

Lane  or  LTX  Timeline  or  Schedule 

Unit  Task  Summary  Sheet 

T&EOs  for  Training 

T&EOs  for  OPFOR 

Safety  &  Environmental  Guidance 

Risk  Assessment  Model  &  Worksheet 

Rules  of  Engagement 

Training  Outlines 

List  of  OPFOR  Collective  Countertasks 

List  of  Supporting  Individual  Tasks  for  the  OPFOR 

Individual  Task  Descriptions 

Control  Plan  (Organization  Diagram  &  O/C  Team  Duty  Positions) 
Map  Extract  for  Specific  LTX  Lane 
Training  &  Verification  Plan 
Lane  Training  Planning  Timeline 

Matrix  of  Collective  Tasks  vs  Supporting  Individual  Soldier  Tasks 
Maps  &  Overlays 
AAR  Plan 

Master  Scenario  Events  List 
Event  Guide 
Training  Schedule 
Retraining  Plan 
LTX  Lane  Site  Preparation 
Resource  Requirements 
TADSS  Instructions 
O/C  or  OPFOR  Instructions 
MOA 

Reference  Materials 

Take  Home  Package  Information 
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Appendix  E 

Collective  Exercise  TSP  Component  and  Element  List 
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Collective  Exercise  Training  Support  Package  Component  &  Element  List 
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crews  cross  over  the  tunnels  the  module  “falls' 
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The  names/descriptions  of  items  needed  to 
support  the  exercise. 


_ _ _ _ _ support  the  exercise. 

- _National  Stock  Number  The  stock  numbers  of  the  item. 

- UKh  °f  Issue _ __The  item  quantity  as  issued. 

Additives  of  Petroleum  ~  " — " 


assemblies  and  subassemblies  (repairable  or 
nonrepairable)  that  are  required  for  maintenance 

support  of  all  equipment. _ 

Nomenclature  The  names/descriptions  of  items  needed  to 

support  the  exercise. 


Component/Element  Name  _  Descriptions  Examples 

Starting  Conditions  The  initial  status  for  all  entities  at  the  start  of  the 

(Virtual/Constructive)  exercise. 
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Environmental  Conditions  The  weather  conditions  at  the  start  of  the 

(Virtual/Constructive) _  exercise. _ 
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AAR  Attendees  The  training  unit  and  supporting  personnel  who  TCs,  BCs,  1SG,  XO,  Maint  PSG,  MORT  Sec 

attend  and  participate  in  the  AAR(s). _ Sgt,  FIST  NCOIC,  XO,  Trp  Co _ 
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Component/Element  Name  I  _ Descriptions  Examples 

Event/ Activity  The  major  administrative  activities  involved  in  Squadron  Commander’s  Guidance 

the  development,  preparation,  and  execution  of 
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Observer/Controller  Individuals  who  observe  the  unit’s  task  1  Tank  Crew  Evaluator 

performance,  control  the  exercise,  and  provide  1  S-2  Observer/Controller 

focused  feedback  based  on  the  observations. _ 

Higher/ Adjacent/  Individuals  who  represent  the  Higher,  Adjacent,  1  G3  52nd  Division 

Subordinate  Units  and/or  Subordinate  units  in  the  exercise.  1  201st  ACR 


Component/Element  Name  Descriptions  Examples 

OPFOR  Units  Individuals  or  unit  that  represent  the  OPFOR  in  1  Opposing  Force  Workstation  Operator 

the  exercise. _ 

Civilians/Govemment  Individuals  who  represent  civilians  on  the  1  Refugee 
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Collective  Exercise  TSP  Element  List  -  TR  350-70  Crosswalk 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  _  TR  350-70  Comments 

Developer/POC  Name(s)  History/NBC  History/NBC  in  TR  350-70  identifies  the  TSP 

developer,  POC,  POC  telephone  number,  approving 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

TSP  Development  Status 

Status  History/NBC  Status  in  MAMUT  is  the  state  of  development  for  a 


.  <u 
60  S3  43 

s  £  ~ 

>  8  J 
2  “  ^ 
a. 


CD  uT 
43  <D  . 
^  3D  • 

S  | 
S  c 

rj  <D 

<5  a 

T3  O  <■ 
43 
O  D-i 
0) 


§5  5 

g  2 
>  .22 
w)  K 


*H  O 

&  £\S 
5  g  o 

CD  2  ^2 

0  3^ 
TD  3  H 


§“<  -S 

ie;u 

s  ^  e 

-d  H  Z 


in 

PH 


TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

Task  Number  No  direct  counterpart 

Task  Title  No  direct  counterpart 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

Military  Factors  No  direct  counterpart,  however, 

information  may  be  derived  from 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

Prisoners  of  War  Considerations  POW 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

OPFOR  Task  Organization  No  direct  counterpart,  however,  Semi-Automated  Forces  in  TR  350-70  is  the 

information  may  be  derived  from  identification  and  requirements  for  SAF  according  to 
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TSP  Component  Comparison 
MAMUT  Collective  Element  List  TR  350-70  _ 

Unit  of  Issue  No  direct  counterpart 
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TSP  Component  Comparison  _ 

MAMUT  Collective  Element  List  TR  350-70  Comments 

Starting  Locations  (Virtual/Constructive)  Simulation  Tab  Simulation  Tab  in  TR  350-70  provides  the  set  of 

initialization  data.  The  TSP  developer  with  the 
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information  may  be  derived  from  O/C  act  as  observers/controllers  and  their  roles  in  the 
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TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR  350-70  Comments 

AAR  Plan  No  direct  counterpart,  however.  After  Action  Review/After  Exercise  Report  is  a 

information  may  be  derived  from  After  template  that  guides  data  collection,  recognition  of 


a 

o 

13 

CD 

<D  .ts 

o 

& 

.S  ^ 

*«5  S 

'S 

o 

■+-» 

o 

£  8 

o 

4-* 

CD 

“O 

>v 

Ch 

<D 

e 

<■"2  +-»  CO  4>  c 

<1  t3  -2  M  -C 

^•O  g  OS 

JT>  2  S  a 
«  o  -a  ^  S 
b  «  "  o 

o  CL  £  <D  o 

•|  5  ‘a  ^  g 

i  u-5  s « 

fl  d  w  M 

C  C  O  <-*  0) 

C  fly  X  -G 


Tl  W  ,<D 
£5  CD 

S  -C  ^ 

^  F3  ^ 

c«  “  CL 

c  a  P 

^  Cj  <L) 

•a  |  £ 

S  §3  •§ 
S  S.  £ 


O  *i 

OC  Oh  C 

/-** ' s  4->  O 

If  1 

■gi  a 

^  O 

«  71 

cl  &  23 

c3  71  +-* 


XJ  ’’O 

o  o 


o  o 

<D  cd 


0^  \p4  \Pi  Oh  f* 


O  CL 

O  >> 


<  <  < 
<  <  < 


H  H 
pi  Pi 

<  C. 


F-31 


Who  No  direct  counterpart,  however, 

information  may  be  derived  from 
SATS  Event  Detail  and  the  SATS 
Coordination  Detail 


TSP  Component  Comparison 

MAMUT  Collective  Element  List  TR350-70  Comments 
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TSP  Component  Comparison 

MAM  IT  Collective  Element  List  _  TR  350-70  Comments 

Key  Word  Index  No  direct  counterpart 
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information  may  be  derived  from  Organic 
Unit  Requirements,  OPFOR  Requirement, 
Support  Requirements,  and  0/C 
Requirements. 
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equipment  requirements  for  a  type  of  military 
unit  and  is  the  basis  for  an  authorizations 
document. _ 

No  direct  counterpart,  however.  Customize  Scenario  Guidance  Customize  Scenario  Guidance  in  WF  TSP  is  a 

information  may  be  derived  from  1  _ _ _ [guide  for  users  to  customize  the  scenario  for 
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Exercise  Development  Notes.  their  particular  training  needs.  Allows  users  to 

make  changes  to  the  TSP  that  will  make  it  fit 
his  unit  in  order  to  maximize  its  training  value. 
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